-- Logs begin at Wed 2021-08-25 00:49:48 UTC, end at Wed 2021-08-25 01:45:05 UTC. -- Aug 25 01:19:03.112503 dv-cinder-790014-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 01:19:03.119802 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 25 01:19:03 2021] *** Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: nodename: dv-cinder-790014-2-iscsi Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: machine: x86_64 Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: clock source: unix Aug 25 01:19:03.121773 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: pcre jit disabled Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: detected number of CPU cores: 4 Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: current working directory: / Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: detected binary path: /usr/bin/uwsgi-core Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: your processes number limit is 47680 Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: your memory page size is 4096 bytes Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: detected max file descriptor number: 2048 Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: lock engine: pthread robust mutexes Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: thunder lock: enabled Aug 25 01:19:03.122812 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 01:19:03.123832 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 25 01:19:03.170067 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: Python main interpreter initialized at 0x5598009299c0 Aug 25 01:19:03.170067 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: python threads support enabled Aug 25 01:19:03.170067 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: your server socket listen backlog is limited to 100 connections Aug 25 01:19:03.170067 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: your mercy for graceful operations on workers is 90 seconds Aug 25 01:19:03.170421 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 01:19:03.170538 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: *** Operational MODE: preforking *** Aug 25 01:19:03.170834 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: *** uWSGI is running in multiple interpreter mode *** Aug 25 01:19:03.170834 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: spawned uWSGI master process (pid: 93139) Aug 25 01:19:03.171024 dv-cinder-790014-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 01:19:03.172697 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: spawned uWSGI worker 1 (pid: 93140, cores: 1) Aug 25 01:19:03.172697 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: spawned uWSGI worker 2 (pid: 93141, cores: 1) Aug 25 01:19:03.174950 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 01:19:04.800712 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:19:04.800712 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: from cryptography.utils import int_from_bytes Aug 25 01:19:04.801352 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:19:04.801352 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: from cryptography.utils import int_from_bytes Aug 25 01:19:04.801470 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:19:04.801470 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: from cryptography.utils import int_from_bytes Aug 25 01:19:04.801894 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:19:04.801894 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: from cryptography.utils import int_from_bytes Aug 25 01:19:07.478874 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:19:07.479536 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:19:07.479623 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:19:07.479985 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:19:07.480059 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:19:07.480144 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:19:07.480214 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:19:07.480278 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:19:07.480436 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:19:07.480530 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.480678 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:19:07.480857 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481058 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481203 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481405 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481524 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481721 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.481852 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482036 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482162 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482362 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482483 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482670 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.482843 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483015 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483143 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483332 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483461 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483667 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483795 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.483911 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484027 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790014-2-iscsi {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484228 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484360 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484553 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790014-2-iscsi {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484683 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484868 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.484981 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485170 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485289 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485479 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485591 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485791 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.485904 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.486090 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.486225 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.486407 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.486587 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.487808 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.487943 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488088 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488217 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488347 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488470 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488592 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488721 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488866 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.488993 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489115 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489239 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489367 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489507 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489637 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489758 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489880 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.489962 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490096 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490195 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490285 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490364 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790014-2-iscsi {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490441 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490575 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490658 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790014-2-iscsi {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490766 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.490932 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491060 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491189 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491487 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491574 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491799 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.491938 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492108 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492195 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492426 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492523 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492748 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.492834 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493054 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493149 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493363 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493457 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493684 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493766 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.493998 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494095 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494320 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494471 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494624 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494750 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.494948 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495035 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495253 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495346 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495557 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495650 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495860 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.495945 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496158 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496251 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496404 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496489 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496692 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.496776 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497020 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497114 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497338 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497431 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497657 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497749 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497907 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.497998 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498156 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498242 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498441 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498537 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498799 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.498890 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499111 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499196 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499416 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499502 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499716 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.499807 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500017 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500109 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500318 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500409 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500617 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500702 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.500916 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501014 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501218 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501315 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501516 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501603 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501824 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.501913 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502130 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502215 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502433 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502524 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502761 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.502907 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503081 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503210 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503392 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503516 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503699 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.503820 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504000 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504112 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504338 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504546 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504658 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504772 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.504939 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505052 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505252 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505372 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505554 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505681 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505854 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.505979 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506155 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506287 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506452 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506587 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506792 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.506921 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507095 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507219 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507358 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507483 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507633 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507758 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.507930 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.508056 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.508700 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.508785 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.508863 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.508941 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509017 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509104 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509184 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509268 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509390 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509478 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509686 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509787 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.509986 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510125 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510285 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510371 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510583 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510668 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510912 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.510997 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.511467 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.511565 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.511767 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.511854 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.512068 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.512154 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.512877 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.512968 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513182 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513274 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513498 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513583 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513801 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.513885 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514104 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514190 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514407 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514492 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514729 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.514834 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515036 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515123 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515343 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515428 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515645 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515730 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.515949 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516035 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516254 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516339 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516555 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516642 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516858 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.516945 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517159 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517257 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517461 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517546 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517763 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.517850 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518067 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518151 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518363 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518491 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518665 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518766 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.518992 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519146 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519294 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519393 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519595 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519680 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519892 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.519976 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520192 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520291 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520490 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520581 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520788 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.520873 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521084 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521176 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521380 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521465 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521673 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521761 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.521986 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522084 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522293 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522384 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522592 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522704 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.522919 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.523083 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.523217 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.523303 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.523532 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:19:07.523617 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.523866 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.523953 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524194 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524279 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524509 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524593 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524836 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.524921 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525161 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525246 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525478 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525570 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525789 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.525875 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526095 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526178 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526404 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526497 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526736 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.526824 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527047 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527132 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527353 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527455 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527659 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527753 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.527992 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.528082 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.528857 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.528955 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529182 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529278 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529496 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529583 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529806 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.529900 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530119 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530206 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530428 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530518 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530785 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.530888 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531106 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531194 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531423 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531509 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531731 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.531826 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532067 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532160 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532389 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532474 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532701 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.532787 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533014 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533099 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533320 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533406 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533636 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533721 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.533940 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534024 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534249 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534334 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534551 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534638 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534890 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.534986 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535198 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535283 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535507 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535594 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535835 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.535920 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536142 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536226 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536449 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536535 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536749 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.536840 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537050 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537143 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537350 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537434 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537652 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537736 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.537950 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538048 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538268 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538355 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538581 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538666 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.538911 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539013 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539231 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539315 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539536 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539621 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539843 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.539935 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540148 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540239 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540447 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540531 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540754 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.540841 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541055 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541141 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541355 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541440 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541672 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541764 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.541976 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542064 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542277 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542362 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542584 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542670 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.542911 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543012 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543211 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543298 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543516 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543637 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543849 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.543933 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544155 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544242 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544461 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544547 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544769 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.544862 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545077 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545172 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545379 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545465 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545707 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.545793 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546017 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546177 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546325 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546411 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546646 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546765 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.546986 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547089 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547292 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547379 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547589 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547681 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547892 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.547986 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548191 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548276 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548491 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548576 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548792 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.548878 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549091 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549180 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549387 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549472 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549686 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549773 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.549983 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550075 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550280 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550366 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550579 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550669 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.550918 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551003 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551219 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551307 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551517 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551610 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551815 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.551899 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552110 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552196 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552443 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552528 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552743 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.552834 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553072 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553166 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553402 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553488 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553716 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.553802 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554023 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554116 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554328 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554425 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554634 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554746 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.554965 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555108 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555273 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555361 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555578 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555670 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555885 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.555979 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556192 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556276 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556495 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556579 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556806 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.556902 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557111 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557195 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557426 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557518 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557730 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.557817 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558044 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558129 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558345 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558431 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558657 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.558809 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.559015 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.559144 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.559838 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.559924 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560154 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560247 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560460 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560545 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560765 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.560853 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561070 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561156 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561375 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561459 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561678 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561763 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.561981 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562108 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562284 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562371 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562591 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562704 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.562922 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563007 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563229 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563314 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563534 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563629 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563842 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.563934 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564143 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564228 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564446 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564538 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564744 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.564841 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565055 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565141 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565378 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565477 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565684 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565769 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.565994 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566086 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566297 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566390 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566611 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566743 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.566943 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567039 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567249 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567336 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567636 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567852 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.567944 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568153 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568240 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568458 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568543 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568767 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.568851 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569069 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569155 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569373 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569458 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569672 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569756 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.569981 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570067 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570283 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570369 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570581 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570692 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570905 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.570992 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571212 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571298 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571529 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571627 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571836 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.571922 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572155 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572239 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572460 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572559 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572760 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.572845 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573063 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573149 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573375 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573468 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573679 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573764 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.573979 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.574076 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.574281 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.574375 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.574579 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.574663 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.575498 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.575592 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.575811 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.575899 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576112 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576199 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576425 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576511 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576743 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.576837 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577048 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577135 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577355 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577447 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577660 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577754 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.577964 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578051 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578280 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578371 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578587 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578699 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.578918 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579004 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579224 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579357 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579530 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579619 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579834 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.579921 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580139 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580291 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580447 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580542 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580749 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.580835 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581054 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581147 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581356 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581448 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581657 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581743 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.581962 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.582056 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.582275 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.582533 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.582865 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.582956 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583197 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583296 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583510 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583604 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583825 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.583918 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584140 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584232 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584452 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584537 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584779 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.584865 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585090 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585175 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585396 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585488 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585701 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.585785 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586005 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586091 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586305 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586390 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586606 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586713 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.586940 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587034 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587242 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587327 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587545 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587642 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587845 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.587938 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588146 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588231 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588443 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588537 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588742 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.588828 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589049 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589142 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589347 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589486 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589653 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589740 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.589951 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590043 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590251 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590343 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590579 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590665 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.590927 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591059 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591227 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591313 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591524 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591617 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591824 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.591908 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592122 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592213 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592454 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592546 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592752 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.592837 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593086 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593180 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593409 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593504 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593712 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.593798 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594016 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594103 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594321 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594415 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594628 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594731 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.594954 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595039 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595255 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595343 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595559 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595644 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595862 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.595952 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596163 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596250 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596459 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596545 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596763 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.596855 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597065 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597153 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597382 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597470 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597665 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597750 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.597960 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598045 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598263 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598358 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598557 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598643 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598891 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.598979 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599190 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599282 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599487 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599648 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599786 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.599872 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600090 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600176 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600390 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600488 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600688 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600774 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.600986 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601070 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601279 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601372 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601589 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601675 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601887 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.601972 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602184 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602276 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602482 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602569 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602816 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.602907 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603120 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603219 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603416 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603503 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603731 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.603819 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604031 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604117 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604326 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604412 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604627 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604713 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.604924 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605011 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605220 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605306 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605528 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605660 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605841 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.605934 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606167 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606254 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606467 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606795 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.606883 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607096 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607181 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607396 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607483 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607698 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607786 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.607999 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608084 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608294 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608388 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608593 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608688 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608891 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.608978 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609189 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609288 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609489 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609576 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609802 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.609893 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610105 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610203 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610400 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610485 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610718 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.610819 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611022 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611117 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611358 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611447 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611657 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.611742 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612010 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612097 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612312 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612397 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612625 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612729 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.612933 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613020 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613238 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613323 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613544 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613629 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613845 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.613931 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614142 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614227 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614451 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614545 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614782 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.614872 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615088 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615186 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615388 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615474 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615694 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.615780 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616004 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616088 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616307 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616401 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616615 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616701 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.616932 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617018 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617249 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617344 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617636 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617855 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.617939 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618160 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618255 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618464 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618792 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.618883 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619101 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619251 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619408 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619493 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619713 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.619797 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620020 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620115 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620326 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620411 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620631 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620715 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.620934 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.621020 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.621234 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.621320 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.621541 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.621625 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.622353 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.622443 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.622666 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.622796 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623002 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623097 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623306 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623411 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623610 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623705 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623913 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.623998 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624213 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624299 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624518 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624603 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624818 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.624945 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625236 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625329 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625545 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625631 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625850 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.625944 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626158 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626245 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626463 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626549 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626791 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.626893 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627105 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627193 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627416 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627503 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627717 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.627851 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628131 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628218 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628440 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628526 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628746 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.628907 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629054 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629141 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629355 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629448 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629654 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629748 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.629960 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630051 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630264 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630356 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630565 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630658 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630893 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.630980 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631197 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631282 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631502 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631588 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631802 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.631887 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632119 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632212 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632529 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632621 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632840 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.632937 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633142 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633238 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633645 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633860 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.633946 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634170 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634264 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634490 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634575 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634839 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.634928 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635137 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635237 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635443 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635534 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635751 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.635835 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.636062 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.636457 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.636650 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.636737 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.636960 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.637051 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.637265 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.637358 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638107 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638195 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638412 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638497 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638762 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.638853 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639086 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639171 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639395 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639492 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639715 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.639802 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640124 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640209 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640432 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640515 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640736 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.640902 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641054 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641149 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641359 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641451 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641664 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641750 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.641963 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642050 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642267 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642352 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642565 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642650 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.642900 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643007 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643208 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643302 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643513 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643621 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643822 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.643914 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644127 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644218 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644430 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644531 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644729 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.644828 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645030 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645130 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645334 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645439 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645638 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645730 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.645987 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646080 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646271 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646384 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646585 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646671 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.646915 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647017 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647217 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647311 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647535 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647621 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647841 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.647927 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648141 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648228 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648440 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648525 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648739 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.648825 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649072 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649158 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649371 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649457 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649688 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.649775 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650015 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650157 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650324 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650413 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650646 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650750 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.650994 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651088 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651311 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651396 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651622 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651715 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.651936 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652022 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652236 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652321 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652539 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652634 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652838 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.652944 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653193 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653340 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653494 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653651 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653797 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.653957 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654101 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654267 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654410 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654571 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654732 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.654900 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655034 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655202 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655322 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655525 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655642 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655831 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.655952 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656159 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656272 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656473 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656571 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656778 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.656868 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657082 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657180 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657387 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657474 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657729 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.657815 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.658037 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.658133 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.658511 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.658616 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.658963 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.659289 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.659623 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.659933 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.660336 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.660661 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.660978 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.661295 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.661612 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.661930 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.662240 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.662555 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.662877 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.663376 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.663698 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.663792 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664018 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664111 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664339 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664425 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664721 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.664866 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665057 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665196 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665389 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665514 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665717 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.665830 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666047 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666141 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666378 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666485 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666721 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.666859 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667050 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667137 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667369 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667470 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667679 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667772 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.667990 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668078 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668315 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668410 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668663 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668872 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.668991 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669208 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669330 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669529 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669648 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669848 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.669970 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670168 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670303 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670494 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670581 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670844 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.670958 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671164 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671263 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671481 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671568 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671796 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.671882 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672112 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672208 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672442 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672528 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672769 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.672857 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673077 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673164 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673394 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673493 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673706 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.673794 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674020 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674159 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674326 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674422 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674640 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674792 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.674978 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675073 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675303 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675390 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675626 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675724 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.675945 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676040 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676256 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676356 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676571 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676676 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676883 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.676970 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.677194 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.677406 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.677502 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.677734 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.677821 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678071 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678164 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678399 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678494 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678735 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.678825 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679056 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679142 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679378 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679481 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679706 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.679794 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680022 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680112 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680331 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680414 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680644 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680731 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.680954 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681047 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681259 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681476 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681584 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681798 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.681892 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682138 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682238 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682471 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682558 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682821 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.682920 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.683143 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.683359 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.683503 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.683708 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.683795 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.684027 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.684123 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.684868 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.684960 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.685194 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.685379 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.685506 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.685701 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.685814 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686011 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686137 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686339 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686451 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686648 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686780 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.686985 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.687106 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.687302 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.687419 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.687614 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.687921 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688006 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688227 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688312 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688540 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688634 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688850 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.688936 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689155 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689242 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689467 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689563 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689770 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.689856 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690094 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690180 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690404 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690531 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690735 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.690838 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691043 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691130 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691354 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691441 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691658 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691752 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.691963 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692050 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692267 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692355 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692571 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692659 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692879 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.692973 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693182 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693267 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693483 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693613 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693784 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.693879 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694093 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694187 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694395 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694481 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694721 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.694823 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.695030 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.695116 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.695354 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.695659 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.695962 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696094 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696276 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696412 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696585 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696725 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.696906 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697034 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697228 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697350 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697537 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697659 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697884 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.697973 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.698200 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.698287 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.698560 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.698765 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.698894 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699101 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699188 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699440 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699526 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699780 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.699922 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.700655 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.700743 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.700964 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701057 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701269 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701367 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701573 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701659 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701893 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.701977 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702201 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702314 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702509 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702595 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702839 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.702927 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.703152 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.703243 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.703463 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.703706 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.703792 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704045 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704139 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704369 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704483 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704677 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704764 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.704984 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705079 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705296 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705390 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705628 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705714 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.705936 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706030 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706250 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706335 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706560 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706648 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706899 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.706988 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707208 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707294 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707515 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707601 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707823 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.707910 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708128 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708213 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708435 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708591 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708744 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.708833 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709052 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709139 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709353 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709447 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709657 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709767 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.709996 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710083 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710314 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710408 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710629 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710780 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.710976 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711064 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711292 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711389 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711601 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711688 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.711909 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712003 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712216 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712312 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712524 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712632 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712837 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.712924 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713164 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713260 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713476 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713562 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713778 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.713865 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714088 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714176 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714396 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714484 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714730 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.714822 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715048 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715145 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715383 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715490 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715727 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.715823 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716046 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716132 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716355 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716440 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716672 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716766 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.716981 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717067 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717303 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717390 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717636 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717733 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.717951 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718038 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718262 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718348 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718561 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718655 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718894 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.718981 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719198 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719291 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719506 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719602 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719813 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.719906 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720123 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720209 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720433 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720521 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720739 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.720869 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721064 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721151 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721369 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721456 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721685 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.721771 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722002 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722104 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722310 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722396 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722618 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722797 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.722954 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723052 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723283 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723370 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723592 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723679 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.723907 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724002 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724217 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724304 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724526 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724613 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724832 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.724928 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725146 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725233 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725464 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725558 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725770 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.725858 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726092 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726179 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726408 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726494 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726749 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.726840 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727065 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727153 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727375 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727468 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727702 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727790 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.727957 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:19:07.728043 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.728311 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.728621 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.728975 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.729244 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.729557 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.729881 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.730203 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.730526 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.730878 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.731245 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.731555 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.731896 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.732223 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:19:07.732465 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:19:07.752935 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_db.sqlalchemy.engines [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:07.754179 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:07.828310 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.context [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a01fdc1-2222-4d37-81a2-e9e9ae7940c7(cell1) {{(pid=93141) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 01:19:07.831002 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.context [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a01fdc1-2222-4d37-81a2-e9e9ae7940c7(cell1) {{(pid=93140) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 01:19:07.832528 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:19:07.834146 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:19:07.834973 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:19:07.835132 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_concurrency.lockutils [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:19:07.836698 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_concurrency.lockutils [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:19:07.837061 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:19:07.837487 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_concurrency.lockutils [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:19:07.839445 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_concurrency.lockutils [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:19:07.848151 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_db.sqlalchemy.engines [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:07.850621 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_db.sqlalchemy.engines [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:07.854615 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:07.859113 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:08.206046 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_db.sqlalchemy.engines [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:08.208837 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG oslo_db.sqlalchemy.engines [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:19:08.545155 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: WARNING keystonemiddleware.auth_token [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:19:08.549346 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: WARNING keystonemiddleware.auth_token [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:19:08.551561 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: WARNING keystonemiddleware.auth_token [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:19:08.555795 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: WARNING keystonemiddleware.auth_token [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:19:08.893917 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: WARNING keystonemiddleware.auth_token [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:19:08.899005 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: WARNING keystonemiddleware.auth_token [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:19:08.899983 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: WARNING keystonemiddleware.auth_token [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:19:08.904930 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5598009299c0 pid: 93140 (default app) Aug 25 01:19:08.905740 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: WARNING keystonemiddleware.auth_token [None req-3b27f38d-5094-4208-bda2-c75ebf8db27e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:19:08.906986 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:19:08.908145 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 25 01:19:08.908551 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 789 bytes} [Wed Aug 25 01:19:08 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:19:08.910867 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5598009299c0 pid: 93141 (default app) Aug 25 01:20:27.287914 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:27.288891 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 25 01:20:27.289292 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:27.712869 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-e80d0693-c429-4e61-baef-11d8397983fb admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:27.741956 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-e80d0693-c429-4e61-baef-11d8397983fb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445073 Aug 25 01:20:27.742654 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Aug 25 01:20:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:20:29.930358 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:29.931423 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bc7e45a4-0a65-4b9d-b2db-b00fe546d72c None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 25 01:20:29.932007 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:29.993928 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-9fd1ee07-cc6f-420d-8836-cf3a754f5a1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:30.012951 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:20:30.012951 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:20:30.042938 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-9fd1ee07-cc6f-420d-8836-cf3a754f5a1c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104352 Aug 25 01:20:30.043980 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:30.272198 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-4cef47c1-6a05-43ab-b516-ed495970edb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:30.274753 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:20:30.274753 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: warnings.warn(msg) Aug 25 01:20:30.322889 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-4cef47c1-6a05-43ab-b516-ed495970edb4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269550 Aug 25 01:20:30.323726 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Aug 25 01:20:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:20:32.532452 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-9fd1ee07-cc6f-420d-8836-cf3a754f5a1c admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:32.533457 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-9fd1ee07-cc6f-420d-8836-cf3a754f5a1c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 25 01:20:32.533850 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:32.641152 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bc416009-06fc-4a9e-aa53-bca4fd98558a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:32.659185 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:20:32.659185 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: warnings.warn(msg) Aug 25 01:20:32.678970 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bc416009-06fc-4a9e-aa53-bca4fd98558a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138735 Aug 25 01:20:32.679667 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:32.694861 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-ba400123-4925-4ea7-87bb-ba8799725ba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:32.697150 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:20:32.697150 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:20:32.731643 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-ba400123-4925-4ea7-87bb-ba8799725ba8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042730 Aug 25 01:20:32.732461 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Aug 25 01:20:32 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:20:34.907193 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bc416009-06fc-4a9e-aa53-bca4fd98558a admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:34.908424 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bc416009-06fc-4a9e-aa53-bca4fd98558a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Aug 25 01:20:34.909164 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:34.967590 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-de45fe27-11fe-46fb-b039-a4b1a752fd84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:34.989166 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-de45fe27-11fe-46fb-b039-a4b1a752fd84 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072459 Aug 25 01:20:34.991005 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:35.004096 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-da1f7de0-7f01-4aeb-9f81-1aee84e5b974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:35.031129 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-da1f7de0-7f01-4aeb-9f81-1aee84e5b974 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031356 Aug 25 01:20:35.032283 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Aug 25 01:20:34 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:20:37.245306 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-de45fe27-11fe-46fb-b039-a4b1a752fd84 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:37.246319 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-de45fe27-11fe-46fb-b039-a4b1a752fd84 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 25 01:20:37.246759 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:37.307951 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-98a3d0b9-4ff3-49e5-ac2f-11ed5f46c813 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "disk": 10, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:37.326475 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-98a3d0b9-4ff3-49e5-ac2f-11ed5f46c813 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073092 Aug 25 01:20:37.327231 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:20:37.340201 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-aeef9bdc-4ad1-44c1-a9ed-5e6db34fdbf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:37.362145 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-aeef9bdc-4ad1-44c1-a9ed-5e6db34fdbf4 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026139 Aug 25 01:20:37.362717 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Aug 25 01:20:37 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:20:39.577189 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-98a3d0b9-4ff3-49e5-ac2f-11ed5f46c813 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:39.578190 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-98a3d0b9-4ff3-49e5-ac2f-11ed5f46c813 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 25 01:20:39.578584 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:39.636662 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:39.655467 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070765 Aug 25 01:20:39.656147 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:39 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:39.668638 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-8289dc8b-268e-4a01-b3ff-43fb1d4d0085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:39.692542 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-8289dc8b-268e-4a01-b3ff-43fb1d4d0085 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028002 Aug 25 01:20:39.693290 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Aug 25 01:20:39 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:20:41.875805 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:41.876795 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 25 01:20:41.877182 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:41.936156 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-f481298a-09fd-47e2-a959-ea53fa576d6b admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:41.959488 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-f481298a-09fd-47e2-a959-ea53fa576d6b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075815 Aug 25 01:20:41.960396 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Aug 25 01:20:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:20:44.134579 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:44.135606 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-c05318a8-990b-4581-97bd-149ed36a6cc0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002231 Aug 25 01:20:44.135998 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:44.197468 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-2a4a5561-859e-4d2b-856e-9b69e85eaf98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:44.219121 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-2a4a5561-859e-4d2b-856e-9b69e85eaf98 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076780 Aug 25 01:20:44.219840 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:44 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:44.231769 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-f9e3c90c-3238-4203-97b0-053b2e341afb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:44.256022 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-f9e3c90c-3238-4203-97b0-053b2e341afb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027683 Aug 25 01:20:44.256933 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Aug 25 01:20:44 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:20:46.413059 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-2a4a5561-859e-4d2b-856e-9b69e85eaf98 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:46.414661 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-2a4a5561-859e-4d2b-856e-9b69e85eaf98 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Aug 25 01:20:46.415086 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:46.474015 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-7ad250d9-eebc-4e1d-aa2a-2e6e47a783d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:46.491839 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-7ad250d9-eebc-4e1d-aa2a-2e6e47a783d8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070236 Aug 25 01:20:46.492389 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:20:46.504653 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-675f65b4-91e8-4b01-865c-5c628024da90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:46.528461 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-675f65b4-91e8-4b01-865c-5c628024da90 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027522 Aug 25 01:20:46.529220 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Aug 25 01:20:46 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:20:49.004949 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-7ad250d9-eebc-4e1d-aa2a-2e6e47a783d8 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:49.005950 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-7ad250d9-eebc-4e1d-aa2a-2e6e47a783d8 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 25 01:20:49.006344 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:49.064845 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-35a2c40c-3c8e-456e-86d1-6cfaa8792753 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "disk": 40, "vcpus": 2, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:49.081858 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-35a2c40c-3c8e-456e-86d1-6cfaa8792753 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069071 Aug 25 01:20:49.082401 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:49 2021] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:49.095085 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-f1b27555-d82a-4162-a074-84ee2e43d72a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:49.117128 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-f1b27555-d82a-4162-a074-84ee2e43d72a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025691 Aug 25 01:20:49.117674 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Aug 25 01:20:49 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:20:51.300290 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-35a2c40c-3c8e-456e-86d1-6cfaa8792753 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:51.301300 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-35a2c40c-3c8e-456e-86d1-6cfaa8792753 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 25 01:20:51.301693 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:51.363796 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-16cafd7c-a52f-4b32-9135-e19d2e552f36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80, "vcpus": 4, "name": "m1.large"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:51.382788 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-16cafd7c-a52f-4b32-9135-e19d2e552f36 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071925 Aug 25 01:20:51.384049 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:20:51.396851 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-3cf391ed-2549-43ec-8796-6a97ba6f886e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:51.419979 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-3cf391ed-2549-43ec-8796-6a97ba6f886e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026830 Aug 25 01:20:51.420543 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Aug 25 01:20:51 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:20:53.621957 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-16cafd7c-a52f-4b32-9135-e19d2e552f36 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:20:53.623668 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-16cafd7c-a52f-4b32-9135-e19d2e552f36 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 25 01:20:53.624481 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:20:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:20:53.686478 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "disk": 160, "name": "m1.xlarge", "swap": 0}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:53.706082 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075286 Aug 25 01:20:53.706700 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Aug 25 01:20:53 2021] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:20:53.722371 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d82634d0-ee8d-45d7-8cdc-cba90269e215 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:20:53.747167 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-d82634d0-ee8d-45d7-8cdc-cba90269e215 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028458 Aug 25 01:20:53.762984 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Aug 25 01:20:53 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:21:32.277861 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:32.278931 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 25 01:21:32.279324 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:21:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:32.336986 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-ba231ada-08eb-4558-957b-5fc57a1b0c6d admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:32.353970 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-ba231ada-08eb-4558-957b-5fc57a1b0c6d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068264 Aug 25 01:21:32.354490 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Aug 25 01:21:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:21:33.774128 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:33.775219 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-af25f1a2-9657-4c90-a872-709935af3c18 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 25 01:21:33.775612 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:33.963020 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-2e1c2304-9d74-4478-a91e-b2e39788394c admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:33.968521 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.wsgi [None req-2e1c2304-9d74-4478-a91e-b2e39788394c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 01:21:33.969116 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-2e1c2304-9d74-4478-a91e-b2e39788394c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:33.969906 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-2e1c2304-9d74-4478-a91e-b2e39788394c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.057276 Aug 25 01:21:33.970404 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Aug 25 01:21:33 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:33.980001 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-1b7c0379-a800-48e2-a907-266fba389872 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:34.000715 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-1b7c0379-a800-48e2-a907-266fba389872 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024292 Aug 25 01:21:34.001227 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:21:34.011717 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d12c08db-be1e-430b-8d1d-2a8670acdcd5 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:34.033419 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-d12c08db-be1e-430b-8d1d-2a8670acdcd5 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025390 Aug 25 01:21:34.033933 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:21:34.043475 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-4c59c169-ada0-486f-b8d5-25daaa987280 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:34.048696 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.wsgi [None req-4c59c169-ada0-486f-b8d5-25daaa987280 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 01:21:34.049251 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-4c59c169-ada0-486f-b8d5-25daaa987280 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:34.050041 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-4c59c169-ada0-486f-b8d5-25daaa987280 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010043 Aug 25 01:21:34.050515 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Aug 25 01:21:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:35.382550 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d12c08db-be1e-430b-8d1d-2a8670acdcd5 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:35.383845 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-d12c08db-be1e-430b-8d1d-2a8670acdcd5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001684 Aug 25 01:21:35.384231 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:35.572120 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-a76b35fe-1ddb-46d1-a4ea-23ed2d6c045b admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:35.579118 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.wsgi [None req-a76b35fe-1ddb-46d1-a4ea-23ed2d6c045b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 01:21:35.579672 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-a76b35fe-1ddb-46d1-a4ea-23ed2d6c045b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:35.580442 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-a76b35fe-1ddb-46d1-a4ea-23ed2d6c045b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.058707 Aug 25 01:21:35.580924 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Aug 25 01:21:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 01:21:35.591002 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-3e654953-eb7a-408c-b58e-86f5a1eff0a2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:35.604884 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-3e654953-eb7a-408c-b58e-86f5a1eff0a2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017328 Aug 25 01:21:35.605317 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:21:35.614831 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-c2ad6120-2353-4b1b-abf0-4afebd9f818e admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:35.628018 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-c2ad6120-2353-4b1b-abf0-4afebd9f818e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016507 Aug 25 01:21:35.628508 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:21:35.637916 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-203ae71a-5797-4fa5-8494-a9542f35f020 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:35.642794 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.wsgi [None req-203ae71a-5797-4fa5-8494-a9542f35f020 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 01:21:35.643343 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-203ae71a-5797-4fa5-8494-a9542f35f020 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:35.644102 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-203ae71a-5797-4fa5-8494-a9542f35f020 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.009545 Aug 25 01:21:35.644572 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1191 bytes} [Wed Aug 25 01:21:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:36.973558 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-c2ad6120-2353-4b1b-abf0-4afebd9f818e admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:36.974589 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-c2ad6120-2353-4b1b-abf0-4afebd9f818e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 25 01:21:36.975029 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:37.160718 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d3adc798-eedc-489b-90b6-0000ca30948f admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:37.166840 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.wsgi [None req-d3adc798-eedc-489b-90b6-0000ca30948f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 01:21:37.167407 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d3adc798-eedc-489b-90b6-0000ca30948f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:37.168193 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-d3adc798-eedc-489b-90b6-0000ca30948f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057793 Aug 25 01:21:37.168681 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:21:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 01:21:37.178764 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-69d59c52-6140-455a-9f27-40ce7bc97b14 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:37.191985 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-69d59c52-6140-455a-9f27-40ce7bc97b14 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017287 Aug 25 01:21:37.192438 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:21:37.201877 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:37.214975 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016424 Aug 25 01:21:37.215492 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1211 bytes} [Wed Aug 25 01:21:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:21:37.225248 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-b9d08496-28db-4e69-8c48-6980d6c5705e admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:37.230259 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.wsgi [None req-b9d08496-28db-4e69-8c48-6980d6c5705e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 01:21:37.230850 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-b9d08496-28db-4e69-8c48-6980d6c5705e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:21:37.231626 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-b9d08496-28db-4e69-8c48-6980d6c5705e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010289 Aug 25 01:21:37.232105 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:21:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 01:21:38.559838 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:38.560838 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 25 01:21:38.561231 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:38.749203 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-34c2952b-0026-4f9f-8785-927068cb8640 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:21:38.767757 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-34c2952b-0026-4f9f-8785-927068cb8640 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.069400 Aug 25 01:21:38.768215 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Aug 25 01:21:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:21:40.104871 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:40.105859 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 25 01:21:40.106245 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:40.301105 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-96fa5cca-fb11-4ddc-b10c-29333469e36e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:21:40.318582 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-96fa5cca-fb11-4ddc-b10c-29333469e36e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.074244 Aug 25 01:21:40.319055 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Aug 25 01:21:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:21:41.673291 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:41.674278 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 25 01:21:41.674663 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:41.861511 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-86bc9632-3cf6-4555-be32-d186a739cc0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:21:41.878886 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-86bc9632-3cf6-4555-be32-d186a739cc0a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.067370 Aug 25 01:21:41.879408 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Aug 25 01:21:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:21:43.199469 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:43.200463 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 25 01:21:43.200851 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:43.389756 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-6bea9ba9-ea91-4fd0-8235-3f5ffb72855f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:21:43.406730 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-6bea9ba9-ea91-4fd0-8235-3f5ffb72855f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.068580 Aug 25 01:21:43.407263 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1236 bytes} [Wed Aug 25 01:21:43 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:21:44.738196 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:44.739232 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 25 01:21:44.739622 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:21:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:21:44.930393 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-14dfae86-b738-4db2-aa32-e18b555df273 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:21:44.948932 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-14dfae86-b738-4db2-aa32-e18b555df273 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.068987 Aug 25 01:21:44.949442 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1203 bytes} [Wed Aug 25 01:21:44 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:22:29.011536 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.012526 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-4c45d944-46f6-44df-9929-f548dc6b5fc2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 25 01:22:29.012921 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:22:29.069453 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-bf87fc83-bfe0-476c-9862-91e80d8b964f admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.087981 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-bf87fc83-bfe0-476c-9862-91e80d8b964f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068844 Aug 25 01:22:29.088496 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:22:29.110467 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-d7ad8b18-04ea-460f-8707-ac0f01e0b35f admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.118552 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-d7ad8b18-04ea-460f-8707-ac0f01e0b35f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011632 Aug 25 01:22:29.119225 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:22:29.130136 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-02b0c35c-8d87-4e1d-bda1-2adbafa2a310 admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.137575 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-02b0c35c-8d87-4e1d-bda1-2adbafa2a310 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010789 Aug 25 01:22:29.138071 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:22:29.149095 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-8bf7e8dc-4e56-4cc5-806a-aa6e0e223edc admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.156189 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-8bf7e8dc-4e56-4cc5-806a-aa6e0e223edc admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010377 Aug 25 01:22:29.156688 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:22:29.168218 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:22:29.175345 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010355 Aug 25 01:22:29.175835 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Aug 25 01:22:29 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:23:51.713936 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-36b9c469-987b-4d30-9370-35219f1ea0be tempest-verify_tempest_config-1507178028 tempest-verify_tempest_config-1507178028-project] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:23:51.715917 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-36b9c469-987b-4d30-9370-35219f1ea0be tempest-verify_tempest_config-1507178028 tempest-verify_tempest_config-1507178028-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106361 Aug 25 01:23:51.716440 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Aug 25 01:23:51 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:25:14.657279 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:14.658270 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 25 01:25:14.658655 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:25:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:25:14.911468 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:14.912618 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:25:14.912618 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:25:14.914166 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:14.914614 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:14.915419 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:14.915844 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:14.948992 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-63e363fb-766b-420c-9bf3-ed48f6fc1cab admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.149876 Aug 25 01:25:14.949534 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:25:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:25:16.304346 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:16.305850 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 25 01:25:16.306238 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:25:16.499679 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:16.500958 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:25:16.500958 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:25:16.502764 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:16.503194 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:16.503992 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:16.504494 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:16.523901 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-650c87f0-b6ae-4789-be64-1fe9986bd6f0 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.075921 Aug 25 01:25:16.524383 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:25:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:25:28.307195 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:28.308189 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 25 01:25:28.308582 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:25:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:25:28.499568 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:28.500742 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:25:28.500742 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:25:28.502251 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:28.502704 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:28.503480 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:28.503898 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:28.528378 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-7691eee2-006b-4b31-8eed-810504a91d4b admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.080248 Aug 25 01:25:28.528858 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 37/75] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:25:28 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:25:29.881929 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: DEBUG nova.api.openstack.wsgi [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] Calling method '>' {{(pid=93140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:29.882956 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: INFO nova.api.openstack.requestlog [None req-51bbc884-9d97-42d4-a40e-589cae4005ce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 25 01:25:29.883350 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: [pid: 93140|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1075 bytes} [Wed Aug 25 01:25:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:25:30.072218 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG nova.api.openstack.wsgi [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] Calling method '>' {{(pid=93141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:25:30.073372 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:25:30.073372 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: warnings.warn(msg) Aug 25 01:25:30.074908 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:30.075380 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:30.076164 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:25:30.076595 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: DEBUG oslo_concurrency.lockutils [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:25:30.097882 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: INFO nova.api.openstack.requestlog [None req-e7498d76-5588-41da-aab2-a52215821f50 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.076707 Aug 25 01:25:30.098409 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: [pid: 93141|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1194 bytes} [Wed Aug 25 01:25:30 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:26:25.277745 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: Wed Aug 25 01:26:25 2021 - graceful shutdown triggered... Aug 25 01:26:25.277881 dv-cinder-790014-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 01:26:25.278821 dv-cinder-790014-2-iscsi devstack@n-api.service[93140]: Gracefully killing worker 1 (pid: 93140)... Aug 25 01:26:25.279248 dv-cinder-790014-2-iscsi devstack@n-api.service[93141]: Gracefully killing worker 2 (pid: 93141)... Aug 25 01:26:26.279893 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: worker 1 buried after 1 seconds Aug 25 01:26:26.279893 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: worker 2 buried after 1 seconds Aug 25 01:26:26.280632 dv-cinder-790014-2-iscsi devstack@n-api.service[93139]: goodbye to uWSGI. Aug 25 01:26:26.281453 dv-cinder-790014-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 25 01:26:26.282001 dv-cinder-790014-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 01:26:26.284826 dv-cinder-790014-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 01:26:26.294826 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 01:26:26.297408 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 25 01:26:26 2021] *** Aug 25 01:26:26.297562 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 01:26:26.297696 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 01:26:26.297826 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: nodename: dv-cinder-790014-2-iscsi Aug 25 01:26:26.297947 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: machine: x86_64 Aug 25 01:26:26.298067 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: clock source: unix Aug 25 01:26:26.298188 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: pcre jit disabled Aug 25 01:26:26.298301 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: detected number of CPU cores: 4 Aug 25 01:26:26.298412 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: current working directory: / Aug 25 01:26:26.298522 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: detected binary path: /usr/bin/uwsgi-core Aug 25 01:26:26.298646 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: your processes number limit is 47680 Aug 25 01:26:26.298792 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: your memory page size is 4096 bytes Aug 25 01:26:26.298902 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: detected max file descriptor number: 2048 Aug 25 01:26:26.299025 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: lock engine: pthread robust mutexes Aug 25 01:26:26.299308 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: thunder lock: enabled Aug 25 01:26:26.299619 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 01:26:26.299769 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 25 01:26:26.345041 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: Python main interpreter initialized at 0x55c8e6ace9c0 Aug 25 01:26:26.345041 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: python threads support enabled Aug 25 01:26:26.345041 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: your server socket listen backlog is limited to 100 connections Aug 25 01:26:26.345041 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: your mercy for graceful operations on workers is 90 seconds Aug 25 01:26:26.345497 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 01:26:26.345497 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: *** Operational MODE: preforking *** Aug 25 01:26:26.345770 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: *** uWSGI is running in multiple interpreter mode *** Aug 25 01:26:26.345770 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: spawned uWSGI master process (pid: 108255) Aug 25 01:26:26.345972 dv-cinder-790014-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 01:26:26.350805 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: spawned uWSGI worker 1 (pid: 108270, cores: 1) Aug 25 01:26:26.350805 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: spawned uWSGI worker 2 (pid: 108271, cores: 1) Aug 25 01:26:26.350805 dv-cinder-790014-2-iscsi devstack@n-api.service[108255]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 01:26:28.144302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:26:28.144302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: from cryptography.utils import int_from_bytes Aug 25 01:26:28.145022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:26:28.145022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: from cryptography.utils import int_from_bytes Aug 25 01:26:28.178851 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:26:28.178851 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: from cryptography.utils import int_from_bytes Aug 25 01:26:28.179478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 01:26:28.179478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: from cryptography.utils import int_from_bytes Aug 25 01:26:30.671171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:26:30.671716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:26:30.671977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:26:30.672263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:26:30.672519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:26:30.672903 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.673227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.673546 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.673861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.674187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.674495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.674843 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.675159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.675485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.675860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.676047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.676379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790014-2-iscsi {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.676750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.677076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.677386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.677702 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.678527 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.678887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.679200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.679697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681364 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681680 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.681974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.682284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.682596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.682960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.683273 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.683671 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790014-2-iscsi {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.683989 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.684288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.684603 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.685022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.685354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.685648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.685963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.686287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.686610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.686960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.687261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.687584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.687905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.688212 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.688522 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.688834 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.689159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.689465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.689776 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.690038 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.690339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.690661 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.691005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.691338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.691592 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.691855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.692172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.692488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.692799 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.693105 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.693464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.694285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.694596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.694928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.695241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.695548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.695865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.696181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.696504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.696812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.697132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.697531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.697784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.698093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.698430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.698774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.699093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.699414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.699737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.700060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.700362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.700656 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.700973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.701300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.701607 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.701859 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.702176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.702480 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.702814 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.703123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.703431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.703738 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.704040 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.704347 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.704654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.704959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.705286 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.705602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.705867 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.706175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.706481 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.706813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.707135 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.707455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.707607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 01:26:30.708088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.708236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 01:26:30.708391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.708548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 01:26:30.708708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.708708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.709002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 01:26:30.709002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 01:26:30.709311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.709311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.709612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.709771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.709934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.710114 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.710395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.710547 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.710840 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711165 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711637 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.711949 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.712095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.712340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.712516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.712746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.712985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.713173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.713409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.713580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.713739 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-790014-2-iscsi {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.713896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714363 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714509 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714661 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.714872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.715030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.715185 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.715361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.715579 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.715835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716001 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.716996 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717154 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.717915 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.718067 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.718221 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.718379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.718533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.718725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.718892 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.719066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.719359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.719526 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.719686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.719857 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.720005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.720158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.720336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-790014-2-iscsi {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.720635 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.720793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.721044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.721205 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.721353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.721499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.721658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.721813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.721976 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.722173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.722353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.722584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.722851 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.723160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.723315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.723315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.723725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.723725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.724021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.724181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.724335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.724335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.724635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.724795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.724942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.725096 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.725249 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.725395 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.725560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.725785 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.726026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.726176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.726176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.726459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.726627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.726827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.726984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.727138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.727283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.727283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.727571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.727764 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.727949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.728099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.728253 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.728399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.728399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.728699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.728845 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.728998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.729150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.729301 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.729463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.729610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.729775 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.729928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.730075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.730075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.730375 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.730719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.730891 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.731058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.731058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.731460 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.731609 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.731766 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.731919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.732143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.732295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.732450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.732697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.732697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.732997 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.733306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.733468 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.733655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.733655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.734025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.734180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.734326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.734485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.734485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.734809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.734971 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.735118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.735263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.735263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.735557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.735711 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.735948 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.736188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.736340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.736497 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.736643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.736788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.736941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.737106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.737261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.737415 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.737570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.737717 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.737873 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.738025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.738185 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.738339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.738485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.738638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.738825 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.738983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.739166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.739317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.739477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.739623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.739769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.739914 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.740068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.740215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.740986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.741352 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.741508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.741669 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.741836 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.741990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.742144 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.742299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.742444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.742598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.742857 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.743010 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.743164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.743460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.743755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.743944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.744197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.744369 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.744524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.744670 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.744824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.744970 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.745130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.745285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.745432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.745579 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.745725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.745879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.746124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.746361 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.746534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.746702 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.746855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.747018 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.747178 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.747325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.747487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.747642 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.747798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.748019 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.748169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.748323 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.748470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.748634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.748792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.748948 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.749102 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.749252 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.749406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.749560 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.749717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.749871 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.750025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.750172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.750327 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.750482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.750647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.750838 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.751132 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.751298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.751557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.751710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.751857 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.752004 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.752149 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.752309 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.752463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.752709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.752900 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.753120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.753273 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.753550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.753703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.753944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.754103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.754347 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.754508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.754664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.754862 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.755011 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.755165 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.755322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.755475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.755631 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.755777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.756695 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.756858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.757016 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.757172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.757172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.757459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.757605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.757750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.757904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.758077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.758236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.758391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.758391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.758708 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.758863 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.759028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.759028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.759316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.759316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.759593 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 01:26:30.759747 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.759907 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760529 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760685 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760832 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.760978 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.761275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.761427 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.761574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.761747 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.761982 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.762156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.762307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.762461 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.762607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.762806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.763147 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.763314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.763471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.763991 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.764211 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.764397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.764630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.764783 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.764941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765249 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.765863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766010 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766328 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.766940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.767921 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768114 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768449 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.768920 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769102 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769373 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769811 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.769978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770062 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770346 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770613 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770874 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.770874 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.771842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.772969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.773070 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.773308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.773500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.773606 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.773929 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.774115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.774224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.774541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.774802 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.774923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.775187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.775290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.775505 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.775810 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.775912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.776138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.776420 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.776590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.776759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.777032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.777133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.777424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.777616 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.777738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.778068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.778195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.778396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.778728 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.778841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.779040 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.779331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.779425 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.779652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.779917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.780036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.780532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.780641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.780739 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.780863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.781078 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.781185 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.781498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.781660 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.781764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.782059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.782253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.782445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.782722 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.782860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.783022 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.783357 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.783478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.783637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.783950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.784055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.784284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.784634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.784935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.785051 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.785285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.785509 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.785604 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.785919 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.786094 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.786236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.786553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.786709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.786895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.787239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.787355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.787559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.787845 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.787940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.788191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.788444 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.788547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.788821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.789042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.789143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.789454 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.789624 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.789779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.790093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.790194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.790416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.790723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.790835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.791116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.791300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.791570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.791785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.791895 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.792081 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.792381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.792474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.792704 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.792975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.793086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.793317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.793557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.793663 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.793986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.794115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.794254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.794603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.794734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795074 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.795954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.796264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.796363 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.796584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.796864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.796972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.797238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.797431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.797538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.797856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.798012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.798179 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.798493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.798595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.798829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.799220 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.799328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.799428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.799769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.799895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.800167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.800263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.800361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.800662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.800780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801705 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.801888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.802244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.802387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.802538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.803722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.803964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.804207 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.804368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.804575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.804812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.804812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.805157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.805445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.805664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.805803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.805803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.806980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807131 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807415 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807563 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807563 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807842 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.807982 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808704 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808704 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.808980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809132 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.809922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.810196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.810347 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.810511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.810709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.810856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.811153 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.811295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.811469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.811654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.811953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812112 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812656 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.812995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.813134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.813294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.813501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.813815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.813963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.814102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.814372 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.814516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.814858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815754 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.815920 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.816104 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.816245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.816444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.816691 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.816832 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817240 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.817991 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.818141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.818280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.819167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.819360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.819501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.819640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.819791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.820569 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.820733 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.820733 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.821044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.821184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.821337 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.821478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.821478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822127 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822589 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822932 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.822932 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.823243 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.823397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.823397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.823692 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824681 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.824834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.825202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.825355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.825496 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.825635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.825635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826017 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826163 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826756 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.826910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.827134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.827275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.827459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.827736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.827892 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828685 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.828965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.829124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.829272 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.829463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.829616 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.829878 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830804 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.830948 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.831133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.831344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.831485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.831741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.831890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.832040 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.832338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.832447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.832647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.832949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.833198 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.833302 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.833553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.833816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.833932 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.834216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.834495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.834617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.834843 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.835158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.835262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.835467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.835706 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.835811 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.836090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.836194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.836401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.836641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.836745 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837569 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.837986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.838072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.838231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.838488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.838582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.838870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839787 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.839928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.840098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.840376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.840472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.840702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.840961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841310 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841616 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.841924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842249 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842685 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.842897 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843657 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.843866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.844176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.844540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.844852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.845172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.845497 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.845580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.850792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.850792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851288 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851377 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851819 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.851988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852070 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852234 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852325 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852413 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852571 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852655 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852745 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.852961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853204 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853706 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853797 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.853882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854134 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854400 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854566 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854756 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.854941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855192 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855632 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855902 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.855981 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856144 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856487 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856685 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.856790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.857001 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.857194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.857872 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858182 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.858662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859305 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859452 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.859908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860062 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860663 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.860962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861274 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.861895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.862051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.862212 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.862366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.862701 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.862879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.863047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.863323 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.863505 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.863739 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.863902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.864050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.864196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.864351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.864610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.864867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.865030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.866844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.867950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.868264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.868431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.868596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.868752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.868899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.869044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.869206 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.869362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.869993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.870161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.870320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.870320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.870614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.870996 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871096 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871448 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871743 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.871927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872227 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872534 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.872894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873074 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873246 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873352 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873566 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873792 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.873986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.874197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.874359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.874493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.874788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.874926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875026 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.875922 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876490 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.876976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877064 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877594 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.877830 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878641 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.878974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879626 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.879948 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880051 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.880905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881226 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881838 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.881941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882454 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.882912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883182 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.883814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884349 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884456 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884758 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.884968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885075 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885373 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885572 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.885908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886001 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886213 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886523 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.886992 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.887899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.888115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.888218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.888432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.888540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889728 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.889937 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890243 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890337 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890658 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.890907 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891226 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891863 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.891971 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.892194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.892432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.892526 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.892766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.892859 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893082 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893178 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.893812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894784 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.894995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895307 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895419 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.895934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896026 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896606 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896851 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.896950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897619 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897832 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.897950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898615 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.898938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899551 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899761 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.899855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900074 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900481 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.900809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901346 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901661 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.901972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.902086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.902288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.902396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.902602 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.902736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903140 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903682 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.903903 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904060 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.904862 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905041 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905684 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.905794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906010 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906336 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.906995 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907097 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907330 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.907945 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908358 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.908975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.909200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.909402 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.909507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.909722 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.909824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910060 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910154 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910486 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.910984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.911981 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.912083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.912807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.912911 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913125 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913254 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913441 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913585 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.913916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914076 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914542 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914719 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.914885 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915511 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.915925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.916844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917372 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.917973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.918931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.919039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.919277 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.919576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.919887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.920817 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921127 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921395 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921666 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.921984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922296 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922604 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.922942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.923043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.923262 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.923356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.923608 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.923936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.924246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.924400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.924557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.924727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.924878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925518 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.925836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926341 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926499 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926657 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.926842 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.927000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.927315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.927421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.927633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.927749 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.928501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.928606 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.928837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.928932 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929254 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929788 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.929887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930209 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930529 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.930890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931717 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.931811 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932286 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932388 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.932939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933250 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.933976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934527 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934626 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934867 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.934962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935599 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935808 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.935904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.936844 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937369 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937471 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937801 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.937993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938302 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938646 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.938988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939310 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939731 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.939948 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940262 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940365 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.940973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941513 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941622 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.941947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942168 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.942929 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943461 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.943876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944200 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.944847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945689 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.945794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946011 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946653 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.946986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947420 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.947934 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948650 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.948961 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949274 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.949915 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950539 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.950878 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.951813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952155 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.952976 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953384 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953689 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.953913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.954997 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955212 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955637 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.955938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.956158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.956249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.956488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.956594 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.956727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108270) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:26:30.956820 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.957105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.957415 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.957731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.958052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.958368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.958775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.959140 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.959470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.959799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.960146 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.960463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.960809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.961138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 01:26:30.961385 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 01:26:31.069206 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_db.sqlalchemy.engines [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.077176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_db.sqlalchemy.engines [None req-da51d567-2817-469e-8a45-7104035b021e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.146972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.context [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a01fdc1-2222-4d37-81a2-e9e9ae7940c7(cell1) {{(pid=108270) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 01:26:31.151208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:26:31.152791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:26:31.153599 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:26:31.154928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.context [None req-da51d567-2817-469e-8a45-7104035b021e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a01fdc1-2222-4d37-81a2-e9e9ae7940c7(cell1) {{(pid=108271) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 01:26:31.157186 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:26:31.159171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da51d567-2817-469e-8a45-7104035b021e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:26:31.160773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da51d567-2817-469e-8a45-7104035b021e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:26:31.161595 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da51d567-2817-469e-8a45-7104035b021e None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:26:31.165749 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da51d567-2817-469e-8a45-7104035b021e None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:26:31.168460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_db.sqlalchemy.engines [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.169358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_db.sqlalchemy.engines [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.176994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_db.sqlalchemy.engines [None req-da51d567-2817-469e-8a45-7104035b021e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.178514 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_db.sqlalchemy.engines [None req-da51d567-2817-469e-8a45-7104035b021e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.431982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_db.sqlalchemy.engines [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108270) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.441982 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_db.sqlalchemy.engines [None req-da51d567-2817-469e-8a45-7104035b021e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 01:26:31.760827 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: WARNING keystonemiddleware.auth_token [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:26:31.767719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: WARNING keystonemiddleware.auth_token [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:26:31.769348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: WARNING keystonemiddleware.auth_token [None req-da51d567-2817-469e-8a45-7104035b021e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:26:31.776592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: WARNING keystonemiddleware.auth_token [None req-da51d567-2817-469e-8a45-7104035b021e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:26:32.111725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: WARNING keystonemiddleware.auth_token [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:26:32.117340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: WARNING keystonemiddleware.auth_token [None req-763b6c51-cab8-4dce-a8c7-a44cd5a4f33a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:26:32.122739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e6ace9c0 pid: 108270 (default app) Aug 25 01:26:32.124541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: WARNING keystonemiddleware.auth_token [None req-da51d567-2817-469e-8a45-7104035b021e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 01:26:32.129813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: WARNING keystonemiddleware.auth_token [None req-da51d567-2817-469e-8a45-7104035b021e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 01:26:32.135629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e6ace9c0 pid: 108271 (default app) Aug 25 01:27:05.660761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c0fe8726-9832-4eb3-a322-d9c7ae154505 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Action: 'create', calling method: .version_select at 0x7fd58fa11e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-58602694", "metadata": {"Type": "work"}}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:05.663806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c0fe8726-9832-4eb3-a322-d9c7ae154505 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:05.664961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c0fe8726-9832-4eb3-a322-d9c7ae154505 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.253961 Aug 25 01:27:05.666018 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:27:04 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:27:05.995321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1935eb86-477b-4fa5-9250-38f1ecde5c06 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Action: 'create', calling method: .version_select at 0x7fd58fa61af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1413194928", "metadata": {"Type": "work"}}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:05.997219 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1935eb86-477b-4fa5-9250-38f1ecde5c06 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:05.998401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1935eb86-477b-4fa5-9250-38f1ecde5c06 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.324309 Aug 25 01:27:06.005294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 1/2] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:27:05 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 332 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:27:06.010245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aadf929d-4165-4883-b1fe-eea4409c29ef tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Action: 'create', calling method: .version_select at 0x7fd58fa2c9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1025893105", "metadata": {"Type": "work"}}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:06.011786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aadf929d-4165-4883-b1fe-eea4409c29ef tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:06.013317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aadf929d-4165-4883-b1fe-eea4409c29ef tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006958 Aug 25 01:27:06.018485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:27:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 01:27:06.024753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-68001d6f-4da8-49d2-91e5-5540861a843b tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Calling method '.version_select at 0x7fd58f93b700>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:06.617705 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1341449287", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "400a2ac9-3eb3-4dc0-9993-b410ce65adf5"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:06.619609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-68001d6f-4da8-49d2-91e5-5540861a843b tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] HTTP exception thrown: Volume tempest-invalid-1871475894 could not be found. Aug 25 01:27:06.620669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-68001d6f-4da8-49d2-91e5-5540861a843b tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 404 to user: Volume tempest-invalid-1871475894 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:06.621770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-68001d6f-4da8-49d2-91e5-5540861a843b tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1871475894" status: 404 len: 99 microversion: 2.1 time: 0.601210 Aug 25 01:27:06.622322 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1218 bytes} [Wed Aug 25 01:27:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1871475894 => generated 99 bytes in 602 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 01:27:06.632793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d69cb754-1225-4fc6-8d99-41a9ba7d84ea tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004411 Aug 25 01:27:06.633877 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Aug 25 01:27:06 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 01:27:06.645010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4b266422-f673-4c05-a20f-a168d2335833 tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003894 Aug 25 01:27:06.645898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 4/6] 10.222.0.23 () {58 vars in 1137 bytes} [Wed Aug 25 01:27:06 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 01:27:06.657279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e7f30892-b7ea-4847-8456-3919b6af39ea tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Calling method '.version_select at 0x7fd58f938e50>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:06.721716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-e7f30892-b7ea-4847-8456-3919b6af39ea tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] HTTP exception thrown: Volume 91c8c1a4-a33c-44da-8396-caaba22312bc could not be found. Aug 25 01:27:06.722324 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e7f30892-b7ea-4847-8456-3919b6af39ea tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 404 to user: Volume 91c8c1a4-a33c-44da-8396-caaba22312bc could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:06.723191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e7f30892-b7ea-4847-8456-3919b6af39ea tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/91c8c1a4-a33c-44da-8396-caaba22312bc" status: 404 len: 109 microversion: 2.1 time: 0.071422 Aug 25 01:27:06.723759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 5/7] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:27:06 2021] DELETE /compute/v2.1/os-volumes/91c8c1a4-a33c-44da-8396-caaba22312bc => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:27:06.730191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-599362cf-7ccf-4857-928c-f4537a03395d tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58f938ca0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:06.850637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-599362cf-7ccf-4857-928c-f4537a03395d tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8af3278c-d928-4bb3-a18e-a951a2f59d4e" status: 200 len: 350 microversion: 2.1 time: 0.125487 Aug 25 01:27:06.857764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 6/8] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:27:06 2021] GET /compute/v2.1/os-volumes/8af3278c-d928-4bb3-a18e-a951a2f59d4e => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:06.862222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6ec74002-1ec2-408c-8404-fffb534713ab tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Calling method '.version_select at 0x7fd58f8f4040>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:06.952516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-6ec74002-1ec2-408c-8404-fffb534713ab tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] HTTP exception thrown: Volume 405878af-0b61-437a-80da-ff15f3e642c7 could not be found. Aug 25 01:27:06.953118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6ec74002-1ec2-408c-8404-fffb534713ab tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] Returning 404 to user: Volume 405878af-0b61-437a-80da-ff15f3e642c7 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:06.953956 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6ec74002-1ec2-408c-8404-fffb534713ab tempest-VolumesNegativeTest-1189486371 tempest-VolumesNegativeTest-1189486371-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/405878af-0b61-437a-80da-ff15f3e642c7" status: 404 len: 109 microversion: 2.1 time: 0.095196 Aug 25 01:27:06.954507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 7/9] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:27:06 2021] GET /compute/v2.1/os-volumes/405878af-0b61-437a-80da-ff15f3e642c7 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:27:07.046241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] validate_networks() for [('400a2ac9-3eb3-4dc0-9993-b410ce65adf5', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:07.085546 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-708534862", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "a5c9817c-ab19-470c-afc3-2431f71a9870"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:07.196239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] validate_networks() for [('a5c9817c-ab19-470c-afc3-2431f71a9870', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:08.507210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:08.507808 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:08.508289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:08.508947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:08.509648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:08.542649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:08.543282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:08.544319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:08.544845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:08.623939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Getting quotas for project 98f8fae0130241e28471150fe11feb81. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:08.631378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Getting quotas for user 9e9bbddb949d4a47a4fbd00b9d914521 and project 98f8fae0130241e28471150fe11feb81. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:08.647163 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:08.650458 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:08.782393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-72929f2b-987f-47ff-a591-d1ed7aef9611 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.826725 Aug 25 01:27:08.783086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 8/10] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:27:08.794383 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-212b7603-95d2-4520-90a0-3a3c34023455 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58ef80160>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:08.857879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:08.859045 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:08.859742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:08.860386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:08.861046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:08.889587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:08.890145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:08.891126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:08.891694 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:08.908228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-212b7603-95d2-4520-90a0-3a3c34023455 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/85ddfdc2-12a2-4dcf-b663-4b476f83a470" status: 200 len: 351 microversion: 2.1 time: 0.117838 Aug 25 01:27:08.909226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 9/11] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:27:08 2021] GET /compute/v2.1/os-volumes/85ddfdc2-12a2-4dcf-b663-4b476f83a470 => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:08.927604 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1b55c1ec-7792-42ee-86df-1c4afc2d4307 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:08.928623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1b55c1ec-7792-42ee-86df-1c4afc2d4307 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:08.984094 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:08.994279 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for user d2f7490ad6cf4bed96cfec8a39a65b43 and project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:09.027320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:09.031521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:09.224694 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-39ddff0f-8ca5-4a64-8f32-9549c1ef77bf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.694545 Aug 25 01:27:09.225779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 3/12] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 2697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 01:27:09.236117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-acc1de34-3f9e-47c6-bebb-3985232aba5a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:09.236728 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-acc1de34-3f9e-47c6-bebb-3985232aba5a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:09.276762 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1b55c1ec-7792-42ee-86df-1c4afc2d4307 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:09.327926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1b55c1ec-7792-42ee-86df-1c4afc2d4307 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1214 microversion: 2.1 time: 0.417410 Aug 25 01:27:09.336521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 10/13] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:08 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1214 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:09.710380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-acc1de34-3f9e-47c6-bebb-3985232aba5a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:09.743102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-acc1de34-3f9e-47c6-bebb-3985232aba5a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1218 microversion: 2.1 time: 0.510891 Aug 25 01:27:09.761767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 4/14] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:09 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1218 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:10.353897 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-248b931c-7381-40c9-9534-3a43ed2946b4 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:10.354605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-248b931c-7381-40c9-9534-3a43ed2946b4 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:10.627652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-248b931c-7381-40c9-9534-3a43ed2946b4 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:10.647868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-248b931c-7381-40c9-9534-3a43ed2946b4 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1214 microversion: 2.1 time: 0.297923 Aug 25 01:27:10.651816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 11/15] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:10 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:10.764544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6879f45e-27d8-41f8-bb5a-e2fa2d494208 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:10.765179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6879f45e-27d8-41f8-bb5a-e2fa2d494208 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:10.860849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b0c77e07-6a68-4998-bfbe-305ece3d82ec tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58efa4dc0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:10.965548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b0c77e07-6a68-4998-bfbe-305ece3d82ec tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fb7b1cf0-3f6c-47f5-aec9-bded272f4b6a" status: 200 len: 350 microversion: 2.1 time: 0.109524 Aug 25 01:27:10.966378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 12/16] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:27:10 2021] GET /compute/v2.1/os-volumes/fb7b1cf0-3f6c-47f5-aec9-bded272f4b6a => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:10.985187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d4178f02-389c-4eb0-83e8-9b5e6f38be90 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58ef80af0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.086364 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6879f45e-27d8-41f8-bb5a-e2fa2d494208 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:11.099258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6879f45e-27d8-41f8-bb5a-e2fa2d494208 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1218 microversion: 2.1 time: 0.338318 Aug 25 01:27:11.099849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 5/17] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:10 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1218 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:11.220098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d4178f02-389c-4eb0-83e8-9b5e6f38be90 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.243100 Aug 25 01:27:11.221429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 13/18] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Aug 25 01:27:10 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:11.236289 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e7a68f55-5a25-4f4f-bed7-663fd2f16a45 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58e7c9550>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.491546 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e7a68f55-5a25-4f4f-bed7-663fd2f16a45 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.261658 Aug 25 01:27:11.492771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 6/19] 10.222.0.23 () {58 vars in 1149 bytes} [Wed Aug 25 01:27:11 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:11.504638 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-99a3d043-67c9-4d38-a266-5d0763b3e5ed tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58e73db80>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.662601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-99a3d043-67c9-4d38-a266-5d0763b3e5ed tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161579 Aug 25 01:27:11.664510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 14/20] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Aug 25 01:27:11 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:11.669715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.670850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:11.676068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-21569712-1e14-4e69-9486-19d683a05ccc tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58e73de50>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.686390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:11.686913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:11.688713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:11.689912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:11.787652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-21569712-1e14-4e69-9486-19d683a05ccc tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.116071 Aug 25 01:27:11.788428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 15/21] 10.222.0.23 () {58 vars in 1167 bytes} [Wed Aug 25 01:27:11 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:11.802251 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-72757af5-b01a-4c25-acb3-43005b7c551d tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58f87f1f0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:11.992675 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-72757af5-b01a-4c25-acb3-43005b7c551d tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195857 Aug 25 01:27:11.993237 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 16/22] 10.222.0.23 () {58 vars in 1170 bytes} [Wed Aug 25 01:27:11 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:12.006287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e35e2c5a-cad5-48ef-95b6-6aab43bc7aa7 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58e741160>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:12.134880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:12.157544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3814ea4b-a686-4c5d-b9db-c5ad4ff3978e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1266 microversion: 2.1 time: 0.492702 Aug 25 01:27:12.159593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 7/23] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:11 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1266 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:12.166658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:12.167724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:12.177008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e35e2c5a-cad5-48ef-95b6-6aab43bc7aa7 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.175004 Aug 25 01:27:12.177316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:12.177828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 17/24] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Aug 25 01:27:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:12.177941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:12.179041 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:12.179648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:12.188963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-45d4b38a-1854-49c9-932c-5ef4b811a4ca tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58ef98c10>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:12.283998 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:12.293299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-274cea24-343c-4386-80ae-038875ff8552 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1270 microversion: 2.1 time: 0.131671 Aug 25 01:27:12.296852 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 8/25] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:12 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:12.300571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-45d4b38a-1854-49c9-932c-5ef4b811a4ca tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.115087 Aug 25 01:27:12.300707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 18/26] 10.222.0.23 () {58 vars in 1188 bytes} [Wed Aug 25 01:27:12 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:12.313276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-01984b71-12af-450d-af08-d22e98cf50e4 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] Calling method '.version_select at 0x7fd58e726820>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:12.453466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-01984b71-12af-450d-af08-d22e98cf50e4 tempest-VolumesTestJSON-1570780003 tempest-VolumesTestJSON-1570780003-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.144314 Aug 25 01:27:12.454072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 9/27] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Aug 25 01:27:12 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:13.175109 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:13.176320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:13.184842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:13.188751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:13.189769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:13.190363 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:13.313086 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:13.313957 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:13.327764 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:13.328138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:13.328929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:13.333995 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:13.443267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:13.464370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-23dd6301-4212-4140-95f9-1340503eb274 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1272 microversion: 2.1 time: 0.292805 Aug 25 01:27:13.469189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 19/28] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:13 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:13.508950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:13.519256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1e7418a1-d680-4a62-a129-ba08df870e34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1276 microversion: 2.1 time: 0.207174 Aug 25 01:27:13.519866 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 10/29] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:13 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:14.495983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:14.497688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:14.508880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:14.510319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:14.513354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:14.515764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:14.537949 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:14.539250 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:14.550047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:14.550828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:14.552354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:14.554666 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:14.745334 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:14.753812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-edca0e6c-7bcb-476b-9a5a-f42809ca9b7b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1272 microversion: 2.1 time: 0.262880 Aug 25 01:27:14.759583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 20/30] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:14 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:14.984019 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:14.999089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-55b47fb6-453b-4633-b9f3-7a1c249e134d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.466686 Aug 25 01:27:15.000986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 11/31] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:14 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:15.777636 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:15.778487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:15.795359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:15.795994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:15.796846 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:15.797290 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:16.011790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:16.017215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:16.017863 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:16.032875 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7658a799-0b71-4340-b048-c4bbe0f602f7 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1272 microversion: 2.1 time: 0.258936 Aug 25 01:27:16.036238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 21/32] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:15 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:16.036658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:16.039001 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:16.040115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:16.043044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:16.931765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:16.949469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-39eeea66-c49d-49c8-9c83-1853eac89f68 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.936159 Aug 25 01:27:16.950850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 12/33] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:16 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:17.053552 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:17.054180 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:17.070507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:17.071100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:17.076203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:17.078626 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:17.308978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:17.317019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-22178e68-e4e5-467b-ae4f-ae3cd318c1f6 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1272 microversion: 2.1 time: 0.267388 Aug 25 01:27:17.325541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 22/34] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:17 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:17.971492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:17.972262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:18.004302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:18.007283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:18.013368 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:18.017530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:18.344035 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:18.345598 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:18.355503 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:18.358666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:18.360941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:18.363362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:19.726306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:19.735487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-67121962-d7fd-4930-a831-44db08aefbb9 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 1.396101 Aug 25 01:27:19.738181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:19.748944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 23/35] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:18 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:19.753219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-221aefa5-81a5-4292-b921-4310f5fce7cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 1.787169 Aug 25 01:27:19.755123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 13/36] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:17 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:20.758027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:20.759766 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:20.771951 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:20.772604 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:20.796821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:20.797039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:20.797375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:20.798244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:20.798662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:20.809998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:20.820848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:20.823364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:21.850268 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:21.859047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1386a511-8dc0-412e-928a-ab05e31ac929 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 1.090758 Aug 25 01:27:21.875896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 14/37] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:20 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:21.891934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:21.915610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-958a845a-5b59-4d1c-8bcf-b1edce410d01 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 1.159241 Aug 25 01:27:21.943905 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 24/38] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:20 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:22.885646 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:22.886508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:22.898360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:22.900899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:22.903887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:22.904768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:22.945614 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:22.946964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:22.957490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:22.960242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:22.961942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:22.964752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:23.912855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:23.928761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3124a1ab-832f-4621-9bb5-6c1945a45c16 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 1.049657 Aug 25 01:27:23.938355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 15/39] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:22 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:23.939559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:23.964648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c304c65c-2c5f-42eb-921b-cd265a6a6eb2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 1.023847 Aug 25 01:27:23.978026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 25/40] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:22 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:24.581657 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-0e682382-9ea7-4170-a8f3-340ba0234f2c req-0b74e25c-db66-4e96-a15e-23872df8d1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c445070-60d2-4f2d-8d55-b61613a6f11c", "tag": "8e48c757-7e6e-4b84-9506-7c2d2575918f"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:24.584230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:24.584230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:24.599054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-0e682382-9ea7-4170-a8f3-340ba0234f2c req-0b74e25c-db66-4e96-a15e-23872df8d1e2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:24.599768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-0e682382-9ea7-4170-a8f3-340ba0234f2c req-0b74e25c-db66-4e96-a15e-23872df8d1e2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:24.623816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-0e682382-9ea7-4170-a8f3-340ba0234f2c req-0b74e25c-db66-4e96-a15e-23872df8d1e2 service nova] Creating event network-changed:8e48c757-7e6e-4b84-9506-7c2d2575918f for instance 4c445070-60d2-4f2d-8d55-b61613a6f11c on hv-cinder-79001 Aug 25 01:27:24.624688 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-0e682382-9ea7-4170-a8f3-340ba0234f2c req-0b74e25c-db66-4e96-a15e-23872df8d1e2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 25 01:27:24.626045 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:24.626735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:24.627754 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:24.628418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:24.639355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.compute.rpcapi [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 25 01:27:24.640645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] Releasing lock "compute-rpcapi-router" {{(pid=108270) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 25 01:27:24.673411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-241d9bf4-e718-43e3-9269-82adea40e19f None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731203 Aug 25 01:27:24.674192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 16/41] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:24.727077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: .version_select at 0x7fd58e714ee0>, body: {"keypair": {"name": "tempest-keypair-95550047"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:24.785500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:24.794657 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:25.105105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:25.109544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:25.126782 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-08884c4c-965e-4720-b998-f970fa2ec504 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 1.131251 Aug 25 01:27:25.128166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 26/42] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Aug 25 01:27:23 2021] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:25.133193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:25.134004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:25.140906 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:25.141639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:25.143169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:25.143771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:25.567542 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-73b4ce96-2caf-41dd-a7ee-4ca176631931 req-c5b38a12-2981-460f-b5a1-872ef4bae835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6a7b17-3df9-4469-98d4-9f52900dcf6b", "tag": "2d1aa4ef-42fe-4622-8606-eec77f0c52be"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:25.569719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:25.569719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:25.594082 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-73b4ce96-2caf-41dd-a7ee-4ca176631931 req-c5b38a12-2981-460f-b5a1-872ef4bae835 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:25.596647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-73b4ce96-2caf-41dd-a7ee-4ca176631931 req-c5b38a12-2981-460f-b5a1-872ef4bae835 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:25.623154 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-73b4ce96-2caf-41dd-a7ee-4ca176631931 req-c5b38a12-2981-460f-b5a1-872ef4bae835 service nova] Creating event network-changed:2d1aa4ef-42fe-4622-8606-eec77f0c52be for instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b on hv-cinder-79001 Aug 25 01:27:25.635788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-73b4ce96-2caf-41dd-a7ee-4ca176631931 req-c5b38a12-2981-460f-b5a1-872ef4bae835 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.956935 Aug 25 01:27:25.636499 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 17/43] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:25.654920 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:25.655112 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:25.655723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:25.663958 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4c587a62-c3bd-4fa4-b91b-447d11871fa8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.534338 Aug 25 01:27:25.669760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 27/44] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:25 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:25.673142 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:25.687399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:25.689667 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:25.691533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:26.344653 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:26.355409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-06a4963a-076e-4bbb-b36d-4e26ac9954ef tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.717548 Aug 25 01:27:26.359651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 18/45] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:25 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:26.464349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-912510672", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "941f32ea-0da3-4101-b2fe-5e10ea072419"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:26.589481 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] validate_networks() for [('941f32ea-0da3-4101-b2fe-5e10ea072419', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:26.683115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:26.686405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:26.704344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:26.708543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:26.712099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:26.712815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:27.389704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:27.403099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-59859329-1cd1-4d4f-b284-4efd68cfbb48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.725506 Aug 25 01:27:27.406592 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 19/46] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:26 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:27.418320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:27.423375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:27.431716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:27.432431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:27.433555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:27.434895 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:28.411470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:28.411942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:28.412381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:28.412862 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:28.413405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:28.414819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:28.424080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-76c248dc-b78c-46c3-b124-780942ff78b8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 1.016372 Aug 25 01:27:28.435829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:28.436949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:28.437814 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 20/47] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:27 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:28.438234 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:28.439015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:28.450633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:28.452037 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:28.466825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:28.467288 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Getting quotas for project 9332813e5ed544a58621b5d1c5e0bbba. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:28.467550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:28.469529 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:28.470326 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:28.479089 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Getting quotas for user ae3376227e8648fb9d2e46875db4b998 and project 9332813e5ed544a58621b5d1c5e0bbba. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:28.494918 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:28.503643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:28.618427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7208f191-d6ae-4af6-b6da-9a51295fe7b5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.947517 Aug 25 01:27:28.619839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 28/48] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:27:28.634237 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-336451e3-86a2-4bb5-bced-40d6bbb7db0b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:28.635056 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-336451e3-86a2-4bb5-bced-40d6bbb7db0b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:28.910406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-336451e3-86a2-4bb5-bced-40d6bbb7db0b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:28.920907 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-336451e3-86a2-4bb5-bced-40d6bbb7db0b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1221 microversion: 2.1 time: 0.292959 Aug 25 01:27:28.947091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 29/49] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:28 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1221 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:28.981035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:28.990819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6fedd79e-432e-455f-a55d-1532f76f082b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.550637 Aug 25 01:27:29.001221 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 21/50] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:28 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:29.180491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1748458490", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "941f32ea-0da3-4101-b2fe-5e10ea072419"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:29.284081 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] validate_networks() for [('941f32ea-0da3-4101-b2fe-5e10ea072419', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:29.446069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:29.446661 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:29.456424 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:29.457367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:29.458217 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:29.459726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:30.008855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:30.019036 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4966eb18-9c7a-4e7e-a4d2-15f187f3b336 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.577938 Aug 25 01:27:30.021698 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 22/51] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:29 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:30.026272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:30.027138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:30.056478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:30.057203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:30.061316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:30.062181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:30.938483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:30.945068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:30.945550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:30.945956 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:30.946368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:30.947006 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:30.949982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-dc56adda-9576-436a-8fb6-6c0ed993df64 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.926551 Aug 25 01:27:30.952473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 23/52] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:30 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:30.960710 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:30.961163 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:30.963968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:30.967410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:31.011045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Getting quotas for project 9332813e5ed544a58621b5d1c5e0bbba. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:31.013699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Getting quotas for user ae3376227e8648fb9d2e46875db4b998 and project 9332813e5ed544a58621b5d1c5e0bbba. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:31.037608 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:31.038467 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:31.040629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:31.050990 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:31.052439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:31.055157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:31.056340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:31.057443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:31.157409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fbbf4262-771f-4834-bab5-b36ca8b51f75 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.982502 Aug 25 01:27:31.158867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 30/53] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:29 2021] POST /compute/v2.1/servers => generated 383 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:27:31.175996 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-43edb6c6-a8f9-4e9a-a257-4c18b7557965 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:31.179340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-43edb6c6-a8f9-4e9a-a257-4c18b7557965 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:31.370752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43edb6c6-a8f9-4e9a-a257-4c18b7557965 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:31.378671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-43edb6c6-a8f9-4e9a-a257-4c18b7557965 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1222 microversion: 2.1 time: 0.212956 Aug 25 01:27:31.379021 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 31/54] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:31 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:31.871723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:31.885732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d907a5e1-4e44-414c-81e6-13920007c26e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.853648 Aug 25 01:27:31.891236 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 24/55] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:31 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:31.966506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:31.967285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:31.979476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:31.981153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:31.982784 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:31.983547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:32.396589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:32.397428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:32.403763 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:32.404405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:32.405356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:32.405982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:32.523032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:32.527967 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:32.533070 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bb275cb3-442f-459b-88db-0bf59f82aa9b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1274 microversion: 2.1 time: 0.140936 Aug 25 01:27:32.533920 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 25/56] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:32 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:32.543792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0e476d62-4966-4a79-9eb7-9ce36446e948 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.580048 Aug 25 01:27:32.545387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 32/57] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:31 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:32.903107 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:32.903939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:32.914932 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:32.916837 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:32.919601 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:32.920259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:33.132282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-389583320", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd6ab0d2-8137-4fff-919c-e0812b557a4f"}], "security_groups": [{"name": "tempest-securitygroup--1463570144"}], "key_name": "tempest-keypair-95550047", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:33.321178 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] validate_networks() for [('fd6ab0d2-8137-4fff-919c-e0812b557a4f', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:33.373820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:33.383106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-923ae06f-b868-4081-b9be-d9f627fbd425 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.484181 Aug 25 01:27:33.386968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 26/58] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:32 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:33.552825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:33.555264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:33.564293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:33.565421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:33.570883 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:33.573069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:33.758151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:33.769120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-220cb5b9-7121-4b6a-a487-f417b572ec2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1280 microversion: 2.1 time: 0.221086 Aug 25 01:27:33.773599 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 27/59] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:33 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1280 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:33.783238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:33.784139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:33.810713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:33.812245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:33.813315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:33.817380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.163008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:34.163504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:34.163899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:34.164308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:34.164716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:34.184779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.185235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.186032 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.186466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.198311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:34.210387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f6fdcc7e-7463-4c07-ae28-8f8c4aceca2a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.430301 Aug 25 01:27:34.211163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 28/60] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:33 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:34.268350 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:34.281272 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:34.315491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-1e247ffd-1356-4262-bd43-0e388aac6b85 req-d52166ec-7482-4f89-8822-ad04c2f4a412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8070a9-ffcd-46c1-b623-321a89e97512", "tag": "49373d89-72a8-4af4-8ddd-bb1be8f8d960"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:34.318100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:34.318100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:34.332841 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-1e247ffd-1356-4262-bd43-0e388aac6b85 req-d52166ec-7482-4f89-8822-ad04c2f4a412 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.333785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:34.339371 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-1e247ffd-1356-4262-bd43-0e388aac6b85 req-d52166ec-7482-4f89-8822-ad04c2f4a412 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.339972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:34.373352 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-1e247ffd-1356-4262-bd43-0e388aac6b85 req-d52166ec-7482-4f89-8822-ad04c2f4a412 service nova] Creating event network-changed:49373d89-72a8-4af4-8ddd-bb1be8f8d960 for instance af8070a9-ffcd-46c1-b623-321a89e97512 on hv-cinder-79001 Aug 25 01:27:34.388337 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-1e247ffd-1356-4262-bd43-0e388aac6b85 req-d52166ec-7482-4f89-8822-ad04c2f4a412 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074039 Aug 25 01:27:34.390123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 29/61] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:34.407771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:34.409560 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:34.424578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.427736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.428830 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.429904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.479951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0ecdd45c-a6e1-4182-ae6b-f592cb58fa36 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.349912 Aug 25 01:27:34.491210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 33/62] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:27:34.505368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-615cfe02-5285-4d2c-9b9c-8abf92cb8e01 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:34.506329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-615cfe02-5285-4d2c-9b9c-8abf92cb8e01 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:34.626582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-615cfe02-5285-4d2c-9b9c-8abf92cb8e01 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:34.643116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-615cfe02-5285-4d2c-9b9c-8abf92cb8e01 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1235 microversion: 2.1 time: 0.145107 Aug 25 01:27:34.643775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 34/63] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:34 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1235 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:34.762664 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-a64d7b5c-2b5a-4cf6-91b5-34b951330842 req-3b9ebb4c-4855-48bf-8e19-c1579afc1ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6a7b17-3df9-4469-98d4-9f52900dcf6b", "name": "network-vif-plugged", "status": "completed", "tag": "2d1aa4ef-42fe-4622-8606-eec77f0c52be"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:34.765386 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:34.765386 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:27:34.777574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-a64d7b5c-2b5a-4cf6-91b5-34b951330842 req-3b9ebb4c-4855-48bf-8e19-c1579afc1ca9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.778354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-a64d7b5c-2b5a-4cf6-91b5-34b951330842 req-3b9ebb4c-4855-48bf-8e19-c1579afc1ca9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.822187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-a64d7b5c-2b5a-4cf6-91b5-34b951330842 req-3b9ebb4c-4855-48bf-8e19-c1579afc1ca9 service nova] Creating event network-vif-plugged:2d1aa4ef-42fe-4622-8606-eec77f0c52be for instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b on hv-cinder-79001 Aug 25 01:27:34.824823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-a64d7b5c-2b5a-4cf6-91b5-34b951330842 req-3b9ebb4c-4855-48bf-8e19-c1579afc1ca9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 25 01:27:34.826395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.829467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.832609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.833224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.853421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.compute.rpcapi [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 25 01:27:34.856509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] Releasing lock "compute-rpcapi-router" {{(pid=108271) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 25 01:27:34.936273 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b90ca5b4-779d-48db-982f-59d49e8ee087 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289200 Aug 25 01:27:34.937961 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 35/64] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:34.945586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:34.946776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:34.954343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.955707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.956671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:34.957879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:34.966478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:34.974568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-89c7b6a2-e1b1-4037-8ee5-6d039d172640 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.576820 Aug 25 01:27:34.975160 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 30/65] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:34 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:35.212883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:35.228161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:35.229140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:35.233688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6447cd50-1e73-4f52-b0c2-0cf056bd6296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.294086 Aug 25 01:27:35.237954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 36/66] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:34 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:35.241545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:35.243703 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:35.245884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:35.247481 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:35.527928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-05793ae3-d248-4b31-8caf-afecd65624f5 req-75bd400e-29d7-41e2-944c-41196a0cf5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bb6f59-2965-4a94-a72b-36fd964c7ad4", "tag": "12da0e27-c7a9-42f4-82da-178ee98a8aed"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:35.529577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:35.529577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:27:35.543988 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:35.544833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-05793ae3-d248-4b31-8caf-afecd65624f5 req-75bd400e-29d7-41e2-944c-41196a0cf5b5 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:35.546241 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-05793ae3-d248-4b31-8caf-afecd65624f5 req-75bd400e-29d7-41e2-944c-41196a0cf5b5 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:35.555418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-057702c4-66fa-43d5-bab4-59ce838bff2b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.328261 Aug 25 01:27:35.556724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 31/67] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:35 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:35.581039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-05793ae3-d248-4b31-8caf-afecd65624f5 req-75bd400e-29d7-41e2-944c-41196a0cf5b5 service nova] Creating event network-changed:12da0e27-c7a9-42f4-82da-178ee98a8aed for instance c9bb6f59-2965-4a94-a72b-36fd964c7ad4 on hv-cinder-79001 Aug 25 01:27:35.588788 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-05793ae3-d248-4b31-8caf-afecd65624f5 req-75bd400e-29d7-41e2-944c-41196a0cf5b5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064410 Aug 25 01:27:35.590018 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 37/68] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:35.659453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:35.660063 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:35.677007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:35.677007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:35.677007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:35.677007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:35.817733 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:35.824302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-84199b02-cd77-47ec-b845-6d23fb222d52 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1287 microversion: 2.1 time: 0.168393 Aug 25 01:27:35.825098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 32/69] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:35 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:35.992102 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:35.992806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:36.008992 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.009456 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.012122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.012611 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.259296 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:36.259964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:36.272130 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.272804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.273744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.274339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.693469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:36.695955 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:36.705703 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5e9b9ec1-f229-4326-bc80-bc9875cf4f99 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.454650 Aug 25 01:27:36.707514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 33/70] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:36 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:36.720181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a73fac8d-7892-47ad-b2bf-9688e3fd3166 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.732082 Aug 25 01:27:36.721089 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 38/71] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:35 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:36.725740 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:36.726460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:36.733943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.735239 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.736453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.737110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.842230 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:36.843953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:36.851464 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.852604 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.853777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.854439 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:36.938714 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:36.947224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ad14dffb-d7fb-4898-8804-95e473be1f10 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1293 microversion: 2.1 time: 0.109730 Aug 25 01:27:36.947962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 39/72] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:36 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:36.950394 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:36.960026 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f216b1b1-1ca9-4033-93c9-15f0bb586ea5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.251045 Aug 25 01:27:36.960668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 34/73] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:36 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:36.988093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-9b7b33ee-baa4-4b61-ac74-2c3336d8edf5 req-5ae71df3-8f41-4a05-8d23-8a8becb73ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c445070-60d2-4f2d-8d55-b61613a6f11c", "name": "network-vif-plugged", "status": "completed", "tag": "8e48c757-7e6e-4b84-9506-7c2d2575918f"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:36.991545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:36.991545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:27:36.998892 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-9b7b33ee-baa4-4b61-ac74-2c3336d8edf5 req-5ae71df3-8f41-4a05-8d23-8a8becb73ad4 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:36.999532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-9b7b33ee-baa4-4b61-ac74-2c3336d8edf5 req-5ae71df3-8f41-4a05-8d23-8a8becb73ad4 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:37.013090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-9b7b33ee-baa4-4b61-ac74-2c3336d8edf5 req-5ae71df3-8f41-4a05-8d23-8a8becb73ad4 service nova] Creating event network-vif-plugged:8e48c757-7e6e-4b84-9506-7c2d2575918f for instance 4c445070-60d2-4f2d-8d55-b61613a6f11c on hv-cinder-79001 Aug 25 01:27:37.018981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-9b7b33ee-baa4-4b61-ac74-2c3336d8edf5 req-5ae71df3-8f41-4a05-8d23-8a8becb73ad4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Aug 25 01:27:37.019937 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 40/74] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:37.724173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:37.725922 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:37.733811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:37.734249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:37.735054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:37.735475 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:37.738188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:37.738963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:37.752227 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:37.752864 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:37.754891 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:37.755538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:38.068492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:38.100650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3bc123eb-723c-4a29-a6ac-8fd1055c1536 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.378771 Aug 25 01:27:38.101558 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 35/75] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:37 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:38.118128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:38.120093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:38.143029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:38.145324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:38.146353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:38.146874 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:38.200201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:38.212640 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b7e861f3-5eab-4b11-bf67-a8795740e53e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1314 microversion: 2.1 time: 0.478942 Aug 25 01:27:38.216547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 41/76] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:37 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:38.223669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:38.224486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:38.235466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:38.236175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:38.237292 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:38.240620 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:38.737524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:38.742141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:38.752088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-88ea4452-6cbf-45a8-aa65-d1eb5caed039 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1318 microversion: 2.1 time: 0.534233 Aug 25 01:27:38.757603 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2087924a-37a3-4d2a-88e7-2e3559bda46c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.654087 Aug 25 01:27:38.758794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 42/78] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:38 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:38.758991 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 36/78] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:38 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:39.119161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:39.120420 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:39.131291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.132104 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.133296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.133939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.231757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:39.232561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:39.247706 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.249401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.250196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.250902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.334709 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:39.344661 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7be67cc2-bcb5-43d3-8e89-015125c2110c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.231054 Aug 25 01:27:39.348272 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 43/79] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:39 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:39.493225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-898103f7-395f-4b4d-86a0-11491eb5c596 req-0a7f186c-fd5d-4ac7-8940-e3e05d520473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2383f568-887e-4b89-99c4-4dcda46666d0", "tag": "41aa4863-f6b3-4d81-ba00-6960a2966fa7"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:39.495192 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:39.495192 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:27:39.515035 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-898103f7-395f-4b4d-86a0-11491eb5c596 req-0a7f186c-fd5d-4ac7-8940-e3e05d520473 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.515475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-898103f7-395f-4b4d-86a0-11491eb5c596 req-0a7f186c-fd5d-4ac7-8940-e3e05d520473 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.515720 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:39.527386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-05072a02-209a-4a76-90b4-dc6e52b5fc3e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1501 microversion: 2.1 time: 0.299516 Aug 25 01:27:39.529591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 37/80] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:39 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:39.561615 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-898103f7-395f-4b4d-86a0-11491eb5c596 req-0a7f186c-fd5d-4ac7-8940-e3e05d520473 service nova] Creating event network-changed:41aa4863-f6b3-4d81-ba00-6960a2966fa7 for instance 2383f568-887e-4b89-99c4-4dcda46666d0 on hv-cinder-79001 Aug 25 01:27:39.577863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-898103f7-395f-4b4d-86a0-11491eb5c596 req-0a7f186c-fd5d-4ac7-8940-e3e05d520473 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095179 Aug 25 01:27:39.583952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 44/81] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:39.768996 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:39.770290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:39.783602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.787066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.788692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:39.790757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.792212 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.793709 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:39.813351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.817865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:39.819246 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:39.819981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:40.577332 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:40.587540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aaf097f6-3b43-4a87-911a-9ece4fc8ef1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1507 microversion: 2.1 time: 0.822387 Aug 25 01:27:40.588671 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 38/82] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:39 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1507 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:40.593559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-d2998a5f-6011-47b5-b225-719411abe03a req-c9b333b6-f1af-44e5-82d5-0f38413d2107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8070a9-ffcd-46c1-b623-321a89e97512", "name": "network-vif-plugged", "status": "completed", "tag": "49373d89-72a8-4af4-8ddd-bb1be8f8d960"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:40.595388 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:40.595388 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:40.602812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-d2998a5f-6011-47b5-b225-719411abe03a req-c9b333b6-f1af-44e5-82d5-0f38413d2107 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:40.603396 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-d2998a5f-6011-47b5-b225-719411abe03a req-c9b333b6-f1af-44e5-82d5-0f38413d2107 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:40.605795 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:40.617828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-d2998a5f-6011-47b5-b225-719411abe03a req-c9b333b6-f1af-44e5-82d5-0f38413d2107 service nova] Creating event network-vif-plugged:49373d89-72a8-4af4-8ddd-bb1be8f8d960 for instance af8070a9-ffcd-46c1-b623-321a89e97512 on hv-cinder-79001 Aug 25 01:27:40.621242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d362e39b-c850-4884-992d-5f1710143ad8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.847037 Aug 25 01:27:40.623862 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-d2998a5f-6011-47b5-b225-719411abe03a req-c9b333b6-f1af-44e5-82d5-0f38413d2107 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033520 Aug 25 01:27:40.625014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 39/83] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:40.632243 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:40.633203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:40.635341 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 45/84] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:39 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:40.640488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:40.641103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:40.642760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:40.643339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:40.863811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:40.872553 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-42e1ff64-936a-430c-a510-9c8ce7f81d8c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.246228 Aug 25 01:27:40.873929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 40/85] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:40 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:41.257729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1271ee73-ec7c-491c-8e29-bf9519ebfe66"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:41.258817 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:41.270819 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.271600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:41.273122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.274584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:41.641779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:41.642543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:41.652183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.656623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:41.657811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.658397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:41.917592 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:41.936913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-166057c1-147a-4e8d-9efc-4fe6323a4231 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.299829 Aug 25 01:27:41.938990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 41/86] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:41 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:41.946475 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:41.947366 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:41.958075 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-47a91b3a-8732-4095-bb7d-f784354ccd4c tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "POST /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703537 Aug 25 01:27:41.959459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 46/87] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:27:41 2021] POST /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:41.960036 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.960485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:41.961442 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:41.961918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:42.149350 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:42.160819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a345c211-6eeb-4c20-95f7-bf20dd9943a3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.217944 Aug 25 01:27:42.162286 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 42/88] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:41 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:42.205416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55debe88-f9d7-4a8b-ac2d-829ce6e189bc"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:42.206613 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:42.215342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:42.215988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:42.217195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:42.218017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:42.579648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-aae5c519-105d-400c-b9fe-f642aafb031d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378257 Aug 25 01:27:42.580444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 47/89] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:27:42 2021] POST /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:42.727052 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-9d57ed5c-d262-43d7-8ad3-05d0f837f654 req-b9919112-89e9-46db-9287-66fe322cf88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bb6f59-2965-4a94-a72b-36fd964c7ad4", "name": "network-vif-plugged", "status": "completed", "tag": "12da0e27-c7a9-42f4-82da-178ee98a8aed"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:42.728737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:42.728737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:42.735707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9d57ed5c-d262-43d7-8ad3-05d0f837f654 req-b9919112-89e9-46db-9287-66fe322cf88f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:42.736237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9d57ed5c-d262-43d7-8ad3-05d0f837f654 req-b9919112-89e9-46db-9287-66fe322cf88f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:42.748420 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-9d57ed5c-d262-43d7-8ad3-05d0f837f654 req-b9919112-89e9-46db-9287-66fe322cf88f service nova] Creating event network-vif-plugged:12da0e27-c7a9-42f4-82da-178ee98a8aed for instance c9bb6f59-2965-4a94-a72b-36fd964c7ad4 on hv-cinder-79001 Aug 25 01:27:42.754012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-9d57ed5c-d262-43d7-8ad3-05d0f837f654 req-b9919112-89e9-46db-9287-66fe322cf88f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Aug 25 01:27:42.755189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 43/90] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:27:42.959772 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:42.960743 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:42.976834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:42.977143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:42.977927 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:42.978366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:43.182325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:43.183175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:43.194853 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:43.195299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:43.196288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:43.196868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:43.217068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:43.227153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d79d83d5-3280-441d-9da4-43babefd1aa9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.271347 Aug 25 01:27:43.237179 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 48/91] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:42 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:43.354983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:43.363729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f961b36c-b1a8-4cd3-b4ea-16024fd70d79 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1322 microversion: 2.1 time: 0.184805 Aug 25 01:27:43.364794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 44/92] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:43 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:44.246489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:44.247251 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:44.257019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.257472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.258241 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.260429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.381710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:44.382321 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:44.389378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.389892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.390707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.391127 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.535226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:44.546621 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-55f302e5-ef23-4edb-8770-7743f86044ed tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.301939 Aug 25 01:27:44.559727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 49/93] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:44 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:44.642230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:44.650613 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a8eafc98-aea1-4266-a181-fd3c9af1dd7c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1517 microversion: 2.1 time: 0.272961 Aug 25 01:27:44.651977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 45/94] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:44 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:44.674269 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:44.675328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:44.682288 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.682806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.683522 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.683976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.725500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lazy-loading 'flavor' on Instance uuid c9bb6f59-2965-4a94-a72b-36fd964c7ad4 {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:27:44.862923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6c33f17d-bb23-46c0-828b-0b689262b090 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4/action" status: 200 len: 32 microversion: 2.1 time: 0.197388 Aug 25 01:27:44.867735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 50/95] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:44 2021] POST /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:44.872828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:44.873734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:44.880693 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.881128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:44.882447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:44.882913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:45.022120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:45.032605 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-11588741-a260-4c4f-9689-5e092a390a2a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.163334 Aug 25 01:27:45.033802 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 46/96] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:44 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:45.564173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:45.565210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:45.573698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:45.574232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:45.575035 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:45.575472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:45.750073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:45.760158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-04c67acd-4e11-4072-afd6-be029688f064 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.199931 Aug 25 01:27:45.761169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 51/97] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:45 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:46.050465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:46.052013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:46.061077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:46.061912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:46.063061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:46.064202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:46.203196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-145c6316-ec40-4c69-9578-87e938f4e28f req-60115414-d9e9-4b1d-a2dd-018ada9a409e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2383f568-887e-4b89-99c4-4dcda46666d0", "name": "network-vif-plugged", "status": "completed", "tag": "41aa4863-f6b3-4d81-ba00-6960a2966fa7"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:46.206108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:46.206108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:27:46.220483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-145c6316-ec40-4c69-9578-87e938f4e28f req-60115414-d9e9-4b1d-a2dd-018ada9a409e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:46.222056 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-145c6316-ec40-4c69-9578-87e938f4e28f req-60115414-d9e9-4b1d-a2dd-018ada9a409e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:46.244837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-145c6316-ec40-4c69-9578-87e938f4e28f req-60115414-d9e9-4b1d-a2dd-018ada9a409e service nova] Creating event network-vif-plugged:41aa4863-f6b3-4d81-ba00-6960a2966fa7 for instance 2383f568-887e-4b89-99c4-4dcda46666d0 on hv-cinder-79001 Aug 25 01:27:46.251641 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-145c6316-ec40-4c69-9578-87e938f4e28f req-60115414-d9e9-4b1d-a2dd-018ada9a409e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052657 Aug 25 01:27:46.252639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 52/98] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:46.353160 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:46.360901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1e40ab83-b678-40b1-975b-7d39e5446bb2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.315010 Aug 25 01:27:46.361473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 47/99] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:46 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:46.780621 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:46.782793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:46.791989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:46.792702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:46.794092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:46.794947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:47.026005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:47.037115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-252725c5-6c0f-427f-9e40-5e62bb34ca4a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1361 microversion: 2.1 time: 0.261662 Aug 25 01:27:47.045867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 53/100] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:46 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:47.378141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:47.379485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:47.389790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:47.390345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:47.391367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:47.393248 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:47.609355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:47.622353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-be2d7ce4-2294-44a4-add0-4c66f598d487 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.247584 Aug 25 01:27:47.623446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 48/101] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:47 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:48.053379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:48.061883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:48.068727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.069411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.070299 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.074046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.212011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:48.219326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-307cac85-59ae-4ba7-9ad9-913cf4ce9df5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1548 microversion: 2.1 time: 0.169457 Aug 25 01:27:48.219778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 54/102] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:48 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:48.236304 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:48.236976 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:48.243010 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.243454 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.244337 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.244767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.368106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6a42f073-7de4-42d0-aaee-7a82f167b2e9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135391 Aug 25 01:27:48.368700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 49/103] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Aug 25 01:27:48 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:48.644119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:48.645128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:48.652076 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.653014 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.654462 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:48.655381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:48.842257 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:48.852268 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ee6ca22f-58b6-4ca8-b5fc-98969dfe1934 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.217172 Aug 25 01:27:48.853175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 55/104] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:48 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:49.869259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:49.869727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:49.884986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:49.886098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:49.887151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:49.888422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:49.944772 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:49.945841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:49.958818 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:49.959526 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:49.961784 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:49.962238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:50.068858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:50.076559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9f47c676-16d0-405c-bc0a-d64a3c707da7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.211017 Aug 25 01:27:50.077628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 50/105] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:49 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:50.084151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-c1d22771-798c-47f7-b466-c3e94f83c0e6 req-8bd0f800-2d9a-4496-b088-33b42d9cbdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2383f568-887e-4b89-99c4-4dcda46666d0", "tag": "41aa4863-f6b3-4d81-ba00-6960a2966fa7"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:50.086137 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:50.086137 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:50.093618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c1d22771-798c-47f7-b466-c3e94f83c0e6 req-8bd0f800-2d9a-4496-b088-33b42d9cbdda service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:50.094257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c1d22771-798c-47f7-b466-c3e94f83c0e6 req-8bd0f800-2d9a-4496-b088-33b42d9cbdda service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:50.111050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4ff09b0f-06c7-460d-80d1-d4a79eda9403 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.169893 Aug 25 01:27:50.111050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 56/106] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:49 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:50.115280 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-c1d22771-798c-47f7-b466-c3e94f83c0e6 req-8bd0f800-2d9a-4496-b088-33b42d9cbdda service nova] Creating event network-changed:41aa4863-f6b3-4d81-ba00-6960a2966fa7 for instance 2383f568-887e-4b89-99c4-4dcda46666d0 on hv-cinder-79001 Aug 25 01:27:50.121052 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-c1d22771-798c-47f7-b466-c3e94f83c0e6 req-8bd0f800-2d9a-4496-b088-33b42d9cbdda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042093 Aug 25 01:27:50.125960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 51/107] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:51.064755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:51.068268 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:51.077726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.078355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.079345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.079918 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.094521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:51.096157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:51.105014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.105548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.106450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.106919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.108940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:27:51.242362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bdbe87eb-edc4-4b69-b3dc-52c03b297f47 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 204 len: 0 microversion: 2.1 time: 0.184237 Aug 25 01:27:51.243778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 57/108] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:27:51 2021] DELETE /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:27:51.250449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:51.252009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:51.260285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.261059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.262099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.262605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.307854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:51.315429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8df2ef6b-541c-4b40-9466-46a741093301 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.225102 Aug 25 01:27:51.316643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 52/109] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:51 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:51.321849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:51.322552 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:51.328753 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.329290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.330138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:51.330634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:51.353577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-507d3dd3-ccdd-4ae0-b3fd-80d99bb5e531 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.106468 Aug 25 01:27:51.355185 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 58/110] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:51 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:51.489246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:51.497959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f69dc301-2a64-4eb0-9bb2-46d1ef2efdf2 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1553 microversion: 2.1 time: 0.180073 Aug 25 01:27:51.508483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 53/111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:51 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:52.334021 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:52.334778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:52.341241 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.341690 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.342446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.342922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.365203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:52.366158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:52.371892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.372325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.373076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.373497 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.465494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:52.480831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d0a31d5e-6c87-4fba-a7c3-db67e1a8f1e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.151342 Aug 25 01:27:52.481398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 59/112] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:52 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:52.515317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:52.515928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:52.522141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.522589 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.523369 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:52.523806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:52.641955 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:52.650239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4e5ee9b7-6d9c-4502-9b33-89383cbef530 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1553 microversion: 2.1 time: 0.138776 Aug 25 01:27:52.650823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 60/113] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:52 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1553 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:53.497135 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:53.497756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:53.510662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:53.511197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:53.511990 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:53.512432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:53.630332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:53.637510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-017ed966-8366-4dab-b98e-a3acbe984ef8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.144304 Aug 25 01:27:53.638069 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 61/114] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:53 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:53.666198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:53.666843 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:53.672299 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:53.672752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:53.673509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:53.673944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:53.790940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:53.798612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-30715870-aafb-4f7e-a8c9-4b83a43b0d9e tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1553 microversion: 2.1 time: 0.135753 Aug 25 01:27:53.799805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 62/115] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:53 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1553 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:54.383218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ed40835d-d84c-4164-9d6e-a36a64e8f395 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 2.021379 Aug 25 01:27:54.383888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 54/116] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:52 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:27:54.654592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:54.655221 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:54.660823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:54.661264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:54.662009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:54.662435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:54.784910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:54.792395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ef0c1914-5cfb-4f1a-91af-2dabe58cd78a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.141433 Aug 25 01:27:54.792954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 63/117] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:54 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:54.817746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:54.818905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:54.827138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:54.827720 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:54.828650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:54.829177 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:54.958962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:54.970660 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f1745fc4-6c06-44fd-b0d4-80958c36dfde tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1553 microversion: 2.1 time: 0.158249 Aug 25 01:27:54.971340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 55/118] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:54 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:55.405013 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:55.406179 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:55.413105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.413678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:55.414844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.415357 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:55.493111 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-accdfb1a-f4fc-4eac-b634-36127239a9cb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.102534 Aug 25 01:27:55.493843 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 64/119] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:55 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:55.809370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:55.810464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:55.816636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.817417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:55.818425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.819341 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:55.965223 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:55.973402 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a28a42fa-c61e-4942-84a5-3698834b37e0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.167730 Aug 25 01:27:55.974050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 56/120] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:55 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:55.989378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:55.990294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:55.997093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.997725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:55.998667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:55.999281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:56.136495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:56.146881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-784e8d77-3dd8-477d-8abf-aefcac07d565 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1553 microversion: 2.1 time: 0.162327 Aug 25 01:27:56.148467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 65/121] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:55 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:56.323715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-a9994d3e-1e0d-428d-8585-31da9d1d3806 req-9a064b72-33d0-4c6b-bdb4-13c44bf9f774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6a7b17-3df9-4469-98d4-9f52900dcf6b", "name": "network-vif-deleted", "tag": "2d1aa4ef-42fe-4622-8606-eec77f0c52be"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:56.325393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:27:56.325393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:27:56.334700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a9994d3e-1e0d-428d-8585-31da9d1d3806 req-9a064b72-33d0-4c6b-bdb4-13c44bf9f774 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:56.335224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a9994d3e-1e0d-428d-8585-31da9d1d3806 req-9a064b72-33d0-4c6b-bdb4-13c44bf9f774 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:56.349786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-a9994d3e-1e0d-428d-8585-31da9d1d3806 req-9a064b72-33d0-4c6b-bdb4-13c44bf9f774 service nova] Creating event network-vif-deleted:2d1aa4ef-42fe-4622-8606-eec77f0c52be for instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b on hv-cinder-79001 Aug 25 01:27:56.356972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-a9994d3e-1e0d-428d-8585-31da9d1d3806 req-9a064b72-33d0-4c6b-bdb4-13c44bf9f774 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038165 Aug 25 01:27:56.357576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 57/122] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:27:56.503511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:56.504420 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:56.510479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:56.510972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:56.511844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:56.512452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:56.608976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f60dff34-bc6e-42a7-85b0-5117a8ea1192 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.109504 Aug 25 01:27:56.612124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 66/123] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:56 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:56.990878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:56.991584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:57.009148 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.009648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.010390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.010861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.164600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:57.165343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:57.171736 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.172189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.172968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.173407 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.207922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.208439 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.208928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lazy-loading 'fault' on Instance uuid 7a6a7b17-3df9-4469-98d4-9f52900dcf6b {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:27:57.322345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9bbddb949d4a47a4fbd00b9d914521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f8fae0130241e28471150fe11feb81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:57.329568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1fa11cca-4fdf-45c0-85d5-f06f45d9f50f tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 200 len: 1350 microversion: 2.1 time: 0.169450 Aug 25 01:27:57.330517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 67/124] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:57 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 1350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:57.375517 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:57.385791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a47f74f4-c212-4795-970f-0a881167b296 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.398936 Aug 25 01:27:57.398213 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 58/125] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:56 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:57.619432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:57.620354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:57.626152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.626603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.627390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:57.627978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:57.716550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-63c1d095-f4fc-4cd8-a566-cc6c74f99ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.100690 Aug 25 01:27:57.719726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 68/126] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:57 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:27:58.012967 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1467900034", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "400a2ac9-3eb3-4dc0-9993-b410ce65adf5"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:58.080639 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] validate_networks() for [('400a2ac9-3eb3-4dc0-9993-b410ce65adf5', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:27:58.349141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:58.350404 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:58.358483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.358869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.359815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.360383 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.380703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] HTTP exception thrown: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. Aug 25 01:27:58.381641 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Returning 404 to user: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:58.382639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-563d99c1-e27a-49c7-93db-290b916a31ce tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 404 len: 111 microversion: 2.1 time: 0.038734 Aug 25 01:27:58.383669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 69/127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:58 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:27:58.405467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:58.406077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:58.416465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.416917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.418825 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.419271 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.580205 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:27:58.581171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:27:58.582687 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:27:58.583314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:27:58.583970 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:27:58.597984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.598430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.599333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.599686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.620191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:27:58.624935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for user d2f7490ad6cf4bed96cfec8a39a65b43 and project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:27:58.638302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:27:58.641534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:58.644774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:27:58.652340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-92d70970-67db-408c-9ba8-703d91ba333d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.250897 Aug 25 01:27:58.652918 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 70/128] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:58 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:27:58.659178 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:58.660607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:58.667778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.668280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.669337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.669965 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.693347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] HTTP exception thrown: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. Aug 25 01:27:58.695669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Returning 404 to user: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:27:58.696715 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-354e7bc0-4639-4967-9c60-2699816fe0e8 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042859 Aug 25 01:27:58.698073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 71/129] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:27:58 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:27:58.730997 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:58.731735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:58.749232 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-55e49cda-a9de-429b-a4a9-ea23c6aa8cea tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727447 Aug 25 01:27:58.755220 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.755327 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 59/130] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:27:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:27:58.755415 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.755415 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:58.759272 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:58.766087 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-63642eeb-8b21-4f5d-8304-f2648e86bd28 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:58.768604 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-63642eeb-8b21-4f5d-8304-f2648e86bd28 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:58.883741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e4b51897-f322-48e6-a8e1-e4bbd4f2394f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.158499 Aug 25 01:27:58.884803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 72/131] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:58 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:27:58.918968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-63642eeb-8b21-4f5d-8304-f2648e86bd28 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:58.931435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-63642eeb-8b21-4f5d-8304-f2648e86bd28 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1218 microversion: 2.1 time: 0.174608 Aug 25 01:27:58.932491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 60/132] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:58 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:59.670560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:59.676160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:59.684525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.685276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.686580 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.687108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.819569 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:27:59.828595 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4166bf7b-2bdf-4c08-90ea-d04b499be061 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.162296 Aug 25 01:27:59.829279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 73/133] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:59 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:27:59.895511 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:27:59.897113 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:59.903464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.903910 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.904678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.905104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.948751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:27:59.953057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:27:59.959477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.959925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.960708 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:27:59.961134 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:27:59.994622 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-68be0894-b229-4972-b091-cdc981bf7ef2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.102467 Aug 25 01:27:59.995643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 61/134] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:27:59 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:28:00.026436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:00.034711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0486e860-1c70-4ed3-9ef2-d4770c949463 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1270 microversion: 2.1 time: 0.089607 Aug 25 01:28:00.035302 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 74/135] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:27:59 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:00.087590 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:00.088428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:00.095841 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.096614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:00.098085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.098529 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:00.112405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] HTTP exception thrown: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. Aug 25 01:28:00.113558 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Returning 404 to user: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:28:00.114477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-87dc149e-d3ab-4676-96d6-47c52d9d988b tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 404 len: 111 microversion: 2.1 time: 0.031488 Aug 25 01:28:00.124370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:00.125065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] [instance: 7a6a7b17-3df9-4469-98d4-9f52900dcf6b] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:00.127983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 62/136] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:28:00 2021] DELETE /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:28:00.132444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.133266 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:00.135199 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.135649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:00.155314 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] HTTP exception thrown: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. Aug 25 01:28:00.156793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] Returning 404 to user: Instance 7a6a7b17-3df9-4469-98d4-9f52900dcf6b could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:28:00.159137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a0d8a2cb-9be7-481e-921a-2f99856be836 tempest-DeleteServersTestJSON-1719243388 tempest-DeleteServersTestJSON-1719243388-project] 10.222.0.23 "GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b" status: 404 len: 111 microversion: 2.1 time: 0.038459 Aug 25 01:28:00.165724 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 75/137] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:00 2021] GET /compute/v2.1/servers/7a6a7b17-3df9-4469-98d4-9f52900dcf6b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:28:00.849386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:00.850820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:00.858961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.860874 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:00.861890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:00.862325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:01.006738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:01.007762 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:01.038364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:01.039154 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:01.041057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:01.042634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:01.126566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-89888542-b97f-4b46-86ff-0b5de0c848be tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.124711 Aug 25 01:28:01.127566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 76/138] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:01 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:28:01.138169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:01.139437 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:01.169279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:01.169803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:01.177869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:01.178074 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:01.261891 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:01.275143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f076225e-5488-4685-96e2-18ce7a3c83cf tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.430601 Aug 25 01:28:01.276408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 63/139] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:00 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:01.473245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:01.481550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8fb65fb3-88d7-43f3-a251-e977a0e33af5 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.351881 Aug 25 01:28:01.482129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 77/140] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:01 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:02.137251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:02.138084 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:02.151232 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.151684 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.152677 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.153118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.257179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-dc552aea-5014-4b5e-8c56-1f174c6b46d2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.123381 Aug 25 01:28:02.260406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 64/141] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:02 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:28:02.294335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:02.295802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:02.307235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.307983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.311655 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.312107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.506568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:02.506568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:02.516727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.517168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.528274 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.533762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.557260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:02.564824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fc6a5e6d-027d-460f-9efe-b0bc592e59b4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.275090 Aug 25 01:28:02.567593 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 78/142] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:02 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:02.849144 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-ba08887b-ad10-4c1f-bebb-09eb806d32f8 req-291d4a30-ccaa-49ce-99fd-bd1370feb12f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d778d2b-3b3c-47da-a582-8738028e63c4", "tag": "123d311e-58d1-4bc6-8a02-ba0daafdb4d1"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:02.852831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:02.852831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:28:02.900742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:02.911312 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4b2a936e-5795-4d57-aa5d-9d609d56a41a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.415041 Aug 25 01:28:02.913266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 65/143] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:02 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:02.929831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-ba08887b-ad10-4c1f-bebb-09eb806d32f8 req-291d4a30-ccaa-49ce-99fd-bd1370feb12f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:02.931054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-ba08887b-ad10-4c1f-bebb-09eb806d32f8 req-291d4a30-ccaa-49ce-99fd-bd1370feb12f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:02.944982 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-ba08887b-ad10-4c1f-bebb-09eb806d32f8 req-291d4a30-ccaa-49ce-99fd-bd1370feb12f service nova] Creating event network-changed:123d311e-58d1-4bc6-8a02-ba0daafdb4d1 for instance 0d778d2b-3b3c-47da-a582-8738028e63c4 on hv-cinder-79001 Aug 25 01:28:02.951478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-ba08887b-ad10-4c1f-bebb-09eb806d32f8 req-291d4a30-ccaa-49ce-99fd-bd1370feb12f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114237 Aug 25 01:28:02.952665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 79/144] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:28:03.268596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:03.270231 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:03.277744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.278354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:03.279468 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.280097 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:03.368676 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8c9265e6-1cdd-4e85-b5aa-74d49f0b1eb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.105045 Aug 25 01:28:03.372446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 66/145] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:03 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:28:03.582617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:03.583786 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:03.592163 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.592652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:03.593491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.594086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:03.752706 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:03.762198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f80d8ff6-537a-4bdc-9dae-6efb931baec9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.183370 Aug 25 01:28:03.777376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6f271efc-2750-4ff9-8911-e4ebb287cbf3 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Action: 'create', calling method: .version_select at 0x7fd58e5bc3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-221234723", "metadata": {"Type": "work"}}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:03.778856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 80/146] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:03 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:03.955875 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:03.956632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:03.966587 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.967405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:03.968480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:03.969119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:04.174627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6f271efc-2750-4ff9-8911-e4ebb287cbf3 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.573506 Aug 25 01:28:04.175869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 67/147] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Aug 25 01:28:03 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 578 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 01:28:04.186262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e12d0a93-7fe4-401f-9913-64a0fa5d017a tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58e68daf0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:04.210159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:04.222935 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-60570e0b-0c87-451b-a01a-195d53481c11 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.293118 Aug 25 01:28:04.234960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 81/148] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:03 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:04.266335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e12d0a93-7fe4-401f-9913-64a0fa5d017a tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 200 len: 352 microversion: 2.1 time: 0.083464 Aug 25 01:28:04.266932 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 68/149] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:28:04 2021] GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:04.379260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:04.380164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:04.386232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:04.386681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:04.387463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:04.387888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:04.459729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f33e034e-7843-47fa-b980-dccb6f17ff5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 14 microversion: 2.1 time: 0.083826 Aug 25 01:28:04.464433 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 82/150] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:04 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:28:04.573199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2059016079", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "21e6a6dc-77f9-423c-af4a-5ce652aeeab8"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:04.637069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] validate_networks() for [('21e6a6dc-77f9-423c-af4a-5ce652aeeab8', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:28:04.783193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:04.786402 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:04.797745 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:04.799104 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:04.801240 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:04.801930 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.037324 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:05.048850 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6dc9ef8b-2334-4a93-a13c-e16f86af67c7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.271926 Aug 25 01:28:05.060642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 83/151] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:04 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:05.107563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:28:05.110896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:28:05.111416 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:28:05.111825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:28:05.112234 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:28:05.129978 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.130795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.131759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.132193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.150265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Getting quotas for project 3d509ebf5e5a4a77820b0e5ea04090c5. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:28:05.155159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Getting quotas for user f3f46b66092d4bc8956f979530a04ed4 and project 3d509ebf5e5a4a77820b0e5ea04090c5. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:28:05.171313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:28:05.174362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:28:05.224457 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d088ee21-a8de-478b-bbb7-1fa902d83711 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654822 Aug 25 01:28:05.225421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 69/152] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:28:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:28:05.238954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-691f13d2-b234-4bb9-a7d7-bcfbc5a1d5d5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.240548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-691f13d2-b234-4bb9-a7d7-bcfbc5a1d5d5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:05.257196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.257935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:05.281911 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.283960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.285260 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.287188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.344882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-691f13d2-b234-4bb9-a7d7-bcfbc5a1d5d5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:05.353681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-691f13d2-b234-4bb9-a7d7-bcfbc5a1d5d5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1214 microversion: 2.1 time: 0.120455 Aug 25 01:28:05.353867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 84/153] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:05 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:05.359752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9ccb989c-2f01-4d3a-b201-d1e0c530ca47 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58dcfcb80>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.471813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9ccb989c-2f01-4d3a-b201-d1e0c530ca47 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 200 len: 353 microversion: 2.1 time: 0.115866 Aug 25 01:28:05.472934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 85/154] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:28:05 2021] GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:05.484451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:05.493206 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3449f329-7a2c-4e6a-9bcc-8a8180d65a0e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.241199 Aug 25 01:28:05.494217 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 70/155] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:05 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:05.498865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-878a995c-ad78-4e6d-8ab9-6c106be9b06a tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58e5e3a60>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.499710 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:05.501711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:05.519521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.520162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.521337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:05.521947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:05.562307 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-878a995c-ad78-4e6d-8ab9-6c106be9b06a tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 200 len: 353 microversion: 2.1 time: 0.066779 Aug 25 01:28:05.563036 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 71/156] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:28:05 2021] GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:05.583798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-14caaa02-9012-4541-b424-379f8eafba08 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58e636700>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.606119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7c1dee20-1f5d-40c2-bb4e-550cc6eea69e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 1518 microversion: 2.1 time: 0.123061 Aug 25 01:28:05.606943 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 86/157] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:05 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 1518 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:05.678188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-14caaa02-9012-4541-b424-379f8eafba08 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 202 len: 0 microversion: 2.1 time: 0.102909 Aug 25 01:28:05.679846 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 72/158] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:28:05 2021] DELETE /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:28:05.688127 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac39be96-2bca-4dbc-a9fe-4168337bf019 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58dca6af0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:05.758505 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ac39be96-2bca-4dbc-a9fe-4168337bf019 tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 200 len: 352 microversion: 2.1 time: 0.074404 Aug 25 01:28:05.763389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 87/159] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:28:05 2021] GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:06.070107 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:06.071097 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:06.079665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.082880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.084698 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.087584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.257868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:06.268516 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-23f9373c-fa48-44f6-a5ea-48781e2c6cf4 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.203783 Aug 25 01:28:06.270049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 73/160] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:06 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:06.371089 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:06.371850 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:06.378658 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.379194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.379967 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.380404 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.447881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:06.455974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a276a97b-1349-4d5d-9c66-a5de87a4d8f6 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1266 microversion: 2.1 time: 0.088624 Aug 25 01:28:06.456624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 88/161] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:06 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:06.514423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:06.515076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:06.521168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.521941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.522748 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.523184 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.617670 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:06.618771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:06.632663 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.633202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.636972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:06.637723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:06.731778 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:06.739581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ebd0f93e-5d5b-405a-8a13-4e7ccf4fb593 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.232952 Aug 25 01:28:06.742919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 74/162] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:06 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:06.774039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1362d4be-8c08-4f87-a937-4ff2c1e5a3f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 9366 microversion: 2.1 time: 0.160851 Aug 25 01:28:06.775390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 89/163] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:06 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 9366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:06.775852 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d814cc14-5aed-4f3c-84fb-f4075e9a3d9f tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Calling method '.version_select at 0x7fd58e68de50>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:06.805245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-d814cc14-5aed-4f3c-84fb-f4075e9a3d9f tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] HTTP exception thrown: Volume e04249c9-c6d1-4378-a0e8-69b236b73234 could not be found. Aug 25 01:28:06.805921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d814cc14-5aed-4f3c-84fb-f4075e9a3d9f tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] Returning 404 to user: Volume e04249c9-c6d1-4378-a0e8-69b236b73234 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:28:06.806854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d814cc14-5aed-4f3c-84fb-f4075e9a3d9f tempest-VolumesGetTestJSON-1311814075 tempest-VolumesGetTestJSON-1311814075-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234" status: 404 len: 109 microversion: 2.1 time: 0.039789 Aug 25 01:28:06.810486 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 75/164] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:28:06 2021] GET /compute/v2.1/os-volumes/e04249c9-c6d1-4378-a0e8-69b236b73234 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:28:07.288041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:07.288989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:07.303643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.304091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.305059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.306615 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.475243 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:07.477028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:07.494894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.495674 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.496618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.497381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.613563 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:07.636057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-87bf9cc4-e49e-490b-8d4e-ee3fe4c426c5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.354137 Aug 25 01:28:07.636855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 90/165] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:07 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:07.758717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:07.759345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:07.766378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.767677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.772329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.773011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.956020 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:07.969088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fab64501-0b70-4a86-8a51-f03c10e9dec9 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.499009 Aug 25 01:28:07.969897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 76/166] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:07 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:07.975046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:07.976187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:07.982951 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.983397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:07.984230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:07.984980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:08.019376 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:08.027928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ae1711fb-5a62-4f16-bf56-599cad09f3df tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.272933 Aug 25 01:28:08.043429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 91/167] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:07 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:08.167708 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-09b243a2-aebd-4043-b648-13031d36a46a req-87eec4b4-28a7-4f37-8a40-c70a14257dea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2171f219-fb7d-44ad-8745-547ca0d893db", "tag": "66ca66df-8b02-49f3-a2dd-b7ae35cfae65"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:08.169474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:08.169474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:28:08.177247 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-09b243a2-aebd-4043-b648-13031d36a46a req-87eec4b4-28a7-4f37-8a40-c70a14257dea service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:08.177974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-09b243a2-aebd-4043-b648-13031d36a46a req-87eec4b4-28a7-4f37-8a40-c70a14257dea service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:08.189446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-09b243a2-aebd-4043-b648-13031d36a46a req-87eec4b4-28a7-4f37-8a40-c70a14257dea service nova] Creating event network-changed:66ca66df-8b02-49f3-a2dd-b7ae35cfae65 for instance 2171f219-fb7d-44ad-8745-547ca0d893db on hv-cinder-79001 Aug 25 01:28:08.194413 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-09b243a2-aebd-4043-b648-13031d36a46a req-87eec4b4-28a7-4f37-8a40-c70a14257dea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031273 Aug 25 01:28:08.195033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 92/168] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:28:08.653868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:08.654553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:08.660455 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:08.660984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:08.661750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:08.662174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:08.808331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:08.815507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-63662481-eb62-4966-8ab0-6e518f605f74 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.166060 Aug 25 01:28:08.818252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 93/169] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:08 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:08.987107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:08.988210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:08.999425 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.000110 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.001098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.001689 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.141630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:09.149129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-35662af0-1a0a-4a92-a307-007a3d1e1cf3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.165629 Aug 25 01:28:09.152198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 94/170] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:08 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:09.160200 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:09.160821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:09.168798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.169387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.170624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.171215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.299606 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:09.307561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a1a2ae77-b2bf-4ed2-a4ba-3a2bdf676a32 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.153486 Aug 25 01:28:09.308151 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 95/171] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:09 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:09.312442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-45bf0d99-67fe-4ddc-995f-68f08910ca85 req-ef0df5f4-a48e-4230-8d94-5fef1bc82345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d778d2b-3b3c-47da-a582-8738028e63c4", "name": "network-vif-plugged", "status": "completed", "tag": "123d311e-58d1-4bc6-8a02-ba0daafdb4d1"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:09.314007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:09.314007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:28:09.321536 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-45bf0d99-67fe-4ddc-995f-68f08910ca85 req-ef0df5f4-a48e-4230-8d94-5fef1bc82345 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.321984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-45bf0d99-67fe-4ddc-995f-68f08910ca85 req-ef0df5f4-a48e-4230-8d94-5fef1bc82345 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.338886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-45bf0d99-67fe-4ddc-995f-68f08910ca85 req-ef0df5f4-a48e-4230-8d94-5fef1bc82345 service nova] Creating event network-vif-plugged:123d311e-58d1-4bc6-8a02-ba0daafdb4d1 for instance 0d778d2b-3b3c-47da-a582-8738028e63c4 on hv-cinder-79001 Aug 25 01:28:09.344517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-45bf0d99-67fe-4ddc-995f-68f08910ca85 req-ef0df5f4-a48e-4230-8d94-5fef1bc82345 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035170 Aug 25 01:28:09.345253 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 96/172] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:09.837732 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:09.839540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:09.846714 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.847164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:09.847940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:09.848396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:10.008700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:10.016174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6168ba78-6284-40ad-a0c3-d77631d827e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.184455 Aug 25 01:28:10.016740 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 97/173] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:09 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:10.165127 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:10.165903 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:10.171939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:10.172399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:10.173150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:10.173576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:10.297168 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:10.305174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-aad20bc1-b587-415f-92e9-e2b8ae139bfb tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.143709 Aug 25 01:28:10.305746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 98/174] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:10 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:10.329884 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:10.330498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:10.337157 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:10.337607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:10.338579 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:10.339041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:10.499332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:10.512608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-53a2e7d0-0f0a-4c21-ac9a-2c3b53e66489 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.186344 Aug 25 01:28:10.513399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 99/175] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:10 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:11.035375 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:11.040449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:11.048986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.049628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.050566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.051184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.052394 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0a1cc03f-284d-4e31-be24-50a34414fe0f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 17834 microversion: 2.1 time: 3.081110 Aug 25 01:28:11.053720 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 77/176] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:07 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 17834 bytes in 3083 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:11.201351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:11.211018 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4396db60-adee-4aa9-8e64-d28f5e207d01 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.181237 Aug 25 01:28:11.211786 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 100/177] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:11 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:11.336475 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:11.337188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:11.343962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.344412 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.345224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.345664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.467504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:11.474779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3891065e-94d9-4926-8396-7469d557739f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.156119 Aug 25 01:28:11.475521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 78/178] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:11 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:11.529105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:11.529845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:11.536082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.536612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.537572 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:11.538128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:11.843627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:11.853095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-538b9aaa-1c31-4c77-9d1b-dc5dcfa55212 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1318 microversion: 2.1 time: 0.326567 Aug 25 01:28:11.855991 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 101/179] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:11 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:12.070593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:12.072418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:12.081555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.082300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.083279 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.083867 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.189910 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d44ff2e1-c44e-4f59-bfdd-0922aefc0cb8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 19446 microversion: 2.1 time: 0.122875 Aug 25 01:28:12.189910 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 79/180] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:12 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 19446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:12.228799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:12.229626 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:12.235760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.236327 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.237188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.238332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.376217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:12.383693 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-252d36e8-396c-40f8-a22d-7ee3a5817ab5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.159206 Aug 25 01:28:12.384258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 102/181] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:12 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:12.491531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:12.492219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:12.498545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.498964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.499714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.500134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.631311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:12.639216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1f2e38ca-7720-4af4-9904-c6f3752b24be tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.151403 Aug 25 01:28:12.639777 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 80/182] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:12 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:12.876152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:12.877532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:12.888686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.889389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:12.890160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:12.890586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.063329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:13.071446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fadba965-eb5f-4622-a762-675320008e94 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1508 microversion: 2.1 time: 0.201864 Aug 25 01:28:13.072209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 103/183] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:12 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:13.088408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55debe88-f9d7-4a8b-ac2d-829ce6e189bc"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:13.089469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.095942 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.096308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.097068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.097516 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.186989 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Invalid volume: volume 55debe88-f9d7-4a8b-ac2d-829ce6e189bc is already attached to instances: 4c445070-60d2-4f2d-8d55-b61613a6f11c Aug 25 01:28:13.187637 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 400 to user: Invalid volume: volume 55debe88-f9d7-4a8b-ac2d-829ce6e189bc is already attached to instances: 4c445070-60d2-4f2d-8d55-b61613a6f11c {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:28:13.188574 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-cd626a88-5d92-4cce-97eb-415f2535b064 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103958 Aug 25 01:28:13.189757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 81/184] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:28:13 2021] POST /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:28:13.201023 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:13.202049 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.209079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.211101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.217868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.218381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.284700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:13.285126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.294968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.295480 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.296327 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.297360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.321155 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-423c72bb-68b1-427f-b681-603c66b46e89 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 21551 microversion: 2.1 time: 0.124337 Aug 25 01:28:13.325411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 104/185] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:13 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 21551 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:13.401490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:13.402206 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.409113 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.409597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.410359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.410829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.436864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lazy-loading 'services' on Instance uuid 4c445070-60d2-4f2d-8d55-b61613a6f11c {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:28:13.559761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6e6f49c0-59df-405f-8ddc-78afb5aa822b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments/55debe88-f9d7-4a8b-ac2d-829ce6e189bc" status: 202 len: 0 microversion: 2.1 time: 0.279628 Aug 25 01:28:13.560594 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 82/186] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:28:13 2021] DELETE /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments/55debe88-f9d7-4a8b-ac2d-829ce6e189bc => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:28:13.569212 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:13.570141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:13.571106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.578398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.578923 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.579702 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.580131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.581368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e29441a1-a787-4d07-89e2-cbe30513b30d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.183424 Aug 25 01:28:13.592202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 105/187] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:13 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:13.623568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d2caa7df-8dd5-4618-8152-3c085625009a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057898 Aug 25 01:28:13.624292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 83/188] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:28:13 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:13.658415 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:13.660322 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:13.677559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.678044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.679443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:13.679872 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:13.885806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:13.893498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ab6c9e8b-c8ed-43fa-ad77-2b1cab2cce60 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.240738 Aug 25 01:28:13.894058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 106/189] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:13 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:14.333613 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:14.334822 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:14.341921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.342595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.343455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.343957 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.437015 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-809bcf3e-bc40-4589-a435-99c580a40b65 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 22707 microversion: 2.1 time: 0.107623 Aug 25 01:28:14.437647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 84/190] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:14 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 22707 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:14.599242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:14.599857 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:14.606381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.607071 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.607846 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.608278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.636478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:14.637515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:14.653325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.654132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.655402 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.655983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.717002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-364beaa9-1788-4e39-8aed-438251e74ba2 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085151 Aug 25 01:28:14.717791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 85/191] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:28:14 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:28:14.783329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:14.792752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6e31121b-668e-4f36-880f-549662535f61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.197484 Aug 25 01:28:14.793385 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 107/192] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:14 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:14.909724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:14.911774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:14.918539 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.919042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:14.920030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:14.920552 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:15.012987 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1629475832", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "400a2ac9-3eb3-4dc0-9993-b410ce65adf5"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:15.070815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:15.080974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2ddf9f1e-faf6-4c82-9164-3e96cbb5dbe3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.175187 Aug 25 01:28:15.081859 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 86/193] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:14 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:15.451853 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:15.451853 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:15.457050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:15.457675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:15.458442 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:15.458918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:15.556255 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5b08a985-ba11-446c-8ffd-900fd5b482f5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 23791 microversion: 2.1 time: 0.110483 Aug 25 01:28:15.557107 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 87/194] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:15 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 23791 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:15.823133 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:15.823964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:15.830727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:15.831211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:15.832214 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:15.832868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:16.042861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:16.053787 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-24b5a0e6-54b3-4c2a-ae29-d7ba726d19b1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.242970 Aug 25 01:28:16.055497 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 88/195] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:15 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:16.100560 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:16.101275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:16.107457 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:16.107999 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:16.108933 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:16.109504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:16.245003 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:16.254191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a2becc6d-5ab9-4c6d-bd74-547b131b6b58 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.157752 Aug 25 01:28:16.254951 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 89/196] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:16 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:16.570098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:16.571336 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:16.578938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:16.579611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:16.580409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:16.580870 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:16.681119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-696566d1-73c5-45ec-a6e2-749b299c4bfc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 24502 microversion: 2.1 time: 0.116346 Aug 25 01:28:16.681757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 90/197] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:16 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 24502 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:17.072773 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:17.073474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:17.080232 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.081459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.082659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.083127 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.227049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:17.235318 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fecb60bb-bef6-4eb2-8681-ee9f403b3bf0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.166749 Aug 25 01:28:17.247729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 91/198] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:17 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:17.261687 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-99ab4800-67dc-464d-919a-9998f66b602f req-1ebef2e3-90ac-44ef-9eb2-fbbaa45c2e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2171f219-fb7d-44ad-8745-547ca0d893db", "name": "network-vif-plugged", "status": "completed", "tag": "66ca66df-8b02-49f3-a2dd-b7ae35cfae65"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:17.264551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:17.264551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:28:17.278411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-99ab4800-67dc-464d-919a-9998f66b602f req-1ebef2e3-90ac-44ef-9eb2-fbbaa45c2e7f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.279139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-99ab4800-67dc-464d-919a-9998f66b602f req-1ebef2e3-90ac-44ef-9eb2-fbbaa45c2e7f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.295197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-99ab4800-67dc-464d-919a-9998f66b602f req-1ebef2e3-90ac-44ef-9eb2-fbbaa45c2e7f service nova] Creating event network-vif-plugged:66ca66df-8b02-49f3-a2dd-b7ae35cfae65 for instance 2171f219-fb7d-44ad-8745-547ca0d893db on hv-cinder-79001 Aug 25 01:28:17.300977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-99ab4800-67dc-464d-919a-9998f66b602f req-1ebef2e3-90ac-44ef-9eb2-fbbaa45c2e7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051448 Aug 25 01:28:17.301899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 92/199] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:17.307797 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:17.308586 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:17.330235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.330707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.331525 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.331953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.484302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:17.494191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b78a2bb6-f1a9-4ce8-9c99-5321eeeff232 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.191036 Aug 25 01:28:17.494937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 93/200] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:17 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:17.693065 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:17.694941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:17.700873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.701405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.702245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:17.702778 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:17.992273 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3abb2bd9-ebfe-43d6-9876-e71699ea1008 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 25600 microversion: 2.1 time: 0.303015 Aug 25 01:28:17.996132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 94/201] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:17 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 25600 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:18.265580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:18.266380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:18.274550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:18.275129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:18.276159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:18.276691 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:18.398951 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:18.406179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8d8579cb-cdf7-40b9-abef-d4f316b79940 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.145258 Aug 25 01:28:18.406851 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 95/202] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:18 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:18.510910 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:18.511631 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:18.517608 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:18.518047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:18.518830 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:18.519284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:18.644854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:18.653542 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a3b48d5a-f5b1-46ef-aecf-7e8fd2fcda06 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1314 microversion: 2.1 time: 0.146176 Aug 25 01:28:18.654165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 96/203] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:18 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:19.003158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:19.004272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:19.009757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.010204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.011053 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.011497 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.137052 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7e9339d9-2111-4085-8bfa-5e7e1ca70ed6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 26100 microversion: 2.1 time: 0.137234 Aug 25 01:28:19.137894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 97/204] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:18 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 26100 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:19.423838 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:19.424534 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:19.431962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.432568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.433539 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.434116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.562183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:19.570056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3f497aa7-0f99-498e-b27b-75df14e08316 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.150183 Aug 25 01:28:19.570616 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 98/205] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:19 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:19.670267 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:19.670906 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:19.677455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.677905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.678704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:19.679148 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:19.801354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:19.808545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e0733734-33e8-4ff3-a7d5-6908f3132abe tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1498 microversion: 2.1 time: 0.141840 Aug 25 01:28:19.809096 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 99/206] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:19 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:20.148392 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:20.149291 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:20.156126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.156733 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.157746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.158283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.254375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b9d54975-e33a-4dbe-8d10-a725dd272512 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 26679 microversion: 2.1 time: 0.108708 Aug 25 01:28:20.255079 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 100/207] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:20 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 26679 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:20.435472 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:20.436061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:20.442782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.443051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.443833 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.444266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.470453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:28:20.566898 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-924581fa-2cff-4f25-a8cc-86c8c93b4238 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 204 len: 0 microversion: 2.1 time: 0.133202 Aug 25 01:28:20.568524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 101/208] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:28:20 2021] DELETE /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 01:28:20.577621 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:20.578311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:20.584143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.584801 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.585645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.586129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.735734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:20.744100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8e9c7020-7d88-4faf-b393-dea0d11b279d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1504 microversion: 2.1 time: 0.170325 Aug 25 01:28:20.744743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 102/209] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:20 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:20.760648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:20.761251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:20.767196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.767648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.768451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:20.768886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:20.931302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:20.939729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-716aa193-231e-453f-97db-6197715f52d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.184466 Aug 25 01:28:20.940430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 103/210] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:20 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:21.265850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:21.267726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:21.274849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.275294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:21.276097 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.277710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:21.375109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-218c5716-13d5-4da2-93b6-b1597533883d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 27088 microversion: 2.1 time: 0.113316 Aug 25 01:28:21.375969 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 104/211] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:21 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 27088 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:21.761450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:21.762195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:21.769942 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.770316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:21.771244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.771673 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:21.896621 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:21.910665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fb3d0f5d-37c8-48b1-a4ce-04f3afcc913e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1504 microversion: 2.1 time: 0.153133 Aug 25 01:28:21.921861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 105/212] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:21 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:21.957676 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:21.958401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:21.964344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.964890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:21.965730 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:21.966855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:22.092886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:22.100944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f4433a18-9b52-4d0d-8216-80b22742589a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.147510 Aug 25 01:28:22.101514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 106/213] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:21 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:22.388311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:22.389556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:22.400116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:22.401224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:22.402027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:22.402466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:22.558122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4848b62f-d6bf-43e8-be97-c3945c90e45b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 27427 microversion: 2.1 time: 0.173982 Aug 25 01:28:22.562037 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 107/214] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:22 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 27427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:22.929721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:22.930503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:22.936858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:22.937393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:22.938218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:22.938739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.095860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:23.107363 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aad10900-5dba-4cf7-8864-4c752ff70e6b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 200 len: 1504 microversion: 2.1 time: 0.181964 Aug 25 01:28:23.108414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 108/215] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:22 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:23.123734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:23.124705 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:23.130953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:23.131542 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.132417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:23.132946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.416099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:23.423536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bfd8556b-4889-4e9a-be14-73ba68e943ed tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.304204 Aug 25 01:28:23.434591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 109/216] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:23 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:23.437791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-9de46965-cb81-4fab-97f0-f64f612f03c0 req-a0db01bf-ec0c-440c-bb09-629230b92ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2171f219-fb7d-44ad-8745-547ca0d893db", "name": "network-vif-deleted", "tag": "66ca66df-8b02-49f3-a2dd-b7ae35cfae65"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:23.437791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:23.437791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:28:23.454077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9de46965-cb81-4fab-97f0-f64f612f03c0 req-a0db01bf-ec0c-440c-bb09-629230b92ec2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:23.454507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9de46965-cb81-4fab-97f0-f64f612f03c0 req-a0db01bf-ec0c-440c-bb09-629230b92ec2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.466715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-9de46965-cb81-4fab-97f0-f64f612f03c0 req-a0db01bf-ec0c-440c-bb09-629230b92ec2 service nova] Creating event network-vif-deleted:66ca66df-8b02-49f3-a2dd-b7ae35cfae65 for instance 2171f219-fb7d-44ad-8745-547ca0d893db on hv-cinder-79001 Aug 25 01:28:23.476503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-9de46965-cb81-4fab-97f0-f64f612f03c0 req-a0db01bf-ec0c-440c-bb09-629230b92ec2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051022 Aug 25 01:28:23.477095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 110/217] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:23.571909 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:23.572913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:23.583553 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:23.584138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.585129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:23.585631 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:23.691396 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-369d1312-48d2-4477-8464-2f8169ee7ce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 27608 microversion: 2.1 time: 0.124746 Aug 25 01:28:23.692716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 111/218] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:23 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 27608 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:24.080069 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] validate_networks() for [('400a2ac9-3eb3-4dc0-9993-b410ce65adf5', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:28:24.125633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:24.126092 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 2171f219-fb7d-44ad-8745-547ca0d893db] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:24.133115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.133574 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.134524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.134985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.148741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] HTTP exception thrown: Instance 2171f219-fb7d-44ad-8745-547ca0d893db could not be found. Aug 25 01:28:24.149690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Returning 404 to user: Instance 2171f219-fb7d-44ad-8745-547ca0d893db could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:28:24.150501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6b351486-bc69-461c-9702-036a6c0fc1f7 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db" status: 404 len: 111 microversion: 2.1 time: 0.029341 Aug 25 01:28:24.151215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 112/219] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:24 2021] GET /compute/v2.1/servers/2171f219-fb7d-44ad-8745-547ca0d893db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:28:24.268431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-124235019", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "21e6a6dc-77f9-423c-af4a-5ce652aeeab8"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:24.323929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] validate_networks() for [('21e6a6dc-77f9-423c-af4a-5ce652aeeab8', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:28:24.615018 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:28:24.615436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:28:24.616117 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:28:24.616530 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:28:24.616941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:28:24.626369 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.627188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.630262 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.630809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.653171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:28:24.657760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for user d2f7490ad6cf4bed96cfec8a39a65b43 and project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:28:24.678324 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:28:24.680885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:28:24.737590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b3ba7eca-7c80-4748-8cef-cd17e56e4869 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.732328 Aug 25 01:28:24.738271 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 108/220] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:28:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 9735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 01:28:24.742843 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:24.743797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:24.750119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.750805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.751778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.752400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.841917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:28:24.842434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:28:24.842950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:28:24.843367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:28:24.843828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:28:24.853818 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.854275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.855106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.855710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.873713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Getting quotas for project 3d509ebf5e5a4a77820b0e5ea04090c5. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:28:24.881779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Getting quotas for user f3f46b66092d4bc8956f979530a04ed4 and project 3d509ebf5e5a4a77820b0e5ea04090c5. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:28:24.907867 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:28:24.910398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:28:24.934512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:24.945244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a91f9072-5499-421d-ab02-26a6a25debc2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.205724 Aug 25 01:28:24.947107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 109/221] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:24 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:24.951924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:24.952914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:24.959471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.959979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.960759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:24.961342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:24.970899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-192a0224-5899-4925-92d3-44722cded772 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706020 Aug 25 01:28:24.977002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 113/222] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:28:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:28:24.981810 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a9e807a0-bd17-433d-b8f7-ba6d21f400cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:24.982648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a9e807a0-bd17-433d-b8f7-ba6d21f400cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:25.045660 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a9e807a0-bd17-433d-b8f7-ba6d21f400cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:25.052704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a9e807a0-bd17-433d-b8f7-ba6d21f400cc tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1218 microversion: 2.1 time: 0.074427 Aug 25 01:28:25.053271 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 114/223] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:24 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:25.065938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fc135f78-6d94-4ccd-8246-192bbba27fb4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:25.067273 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fc135f78-6d94-4ccd-8246-192bbba27fb4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:25.139450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fc135f78-6d94-4ccd-8246-192bbba27fb4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:25.146970 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fc135f78-6d94-4ccd-8246-192bbba27fb4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1213 microversion: 2.1 time: 0.092462 Aug 25 01:28:25.154739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 115/224] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:25 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:25.963314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:25.963959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:25.969810 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:25.970263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:25.971058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:25.971495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:26.087775 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:26.094761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a274b1a8-9b7c-4df7-add2-ca68d2f99982 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.135051 Aug 25 01:28:26.095313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 116/225] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:25 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:26.099447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:26.100046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:26.105298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:26.105740 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:26.106495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:26.106952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:26.166759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:26.173739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8aa18f6f-3cf9-4e5c-8661-f83e5b11559a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1222 microversion: 2.1 time: 0.077502 Aug 25 01:28:26.174310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 117/226] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:26 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:26.178937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:26.179534 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:26.184710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:26.185149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:26.185892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:26.186320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:26.243142 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:26.250036 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3d7d8dfe-5a63-4c7e-914b-fde3f7c26c23 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1217 microversion: 2.1 time: 0.074783 Aug 25 01:28:26.250942 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 118/227] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:26 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:27.112611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:27.113356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:27.113968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f9bfac94-da5d-49d4-abc4-e805d0370013 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 27916 microversion: 2.1 time: 2.164845 Aug 25 01:28:27.118533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 110/228] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:24 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 27916 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:27.120219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.120663 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.121435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.121861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.190111 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:27.191468 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:27.207287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.208046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.208904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.210128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.274715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:27.276489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:27.284373 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-268183b4-ea70-44b0-8e33-229414ad4d57 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1214 microversion: 2.1 time: 0.098082 Aug 25 01:28:27.285319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 111/229] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:27 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:27.289550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:27.290176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:27.296169 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.296617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.297381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:27.297815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:27.300378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e272bdf2-a9be-4bce-8150-59c4051324f5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.177094 Aug 25 01:28:27.301611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 119/230] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:27 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:27.366329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:27.373644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-093a62bb-8308-46cf-8ab2-6cd952e19a1f tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1209 microversion: 2.1 time: 0.087431 Aug 25 01:28:27.374201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 112/231] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:27 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:28.125601 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:28.126556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:28.132295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.132742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.133495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.133926 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.237835 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5e219b77-9a1f-409d-a006-4bef8805de58 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 0.115635 Aug 25 01:28:28.239847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 120/232] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:28 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:28.302003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:28.302566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:28.308988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.309442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.310207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.310638 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.320021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:28.321916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:28.337034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.338073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.338985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.339515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.383493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:28.391844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4165eb5c-e81d-4b94-9cff-0a1ea543d1f3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1276 microversion: 2.1 time: 0.094195 Aug 25 01:28:28.393235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:28 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:28.409839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:28.414211 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:28.425019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.426027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.426878 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:28.427788 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:28.592575 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:28.605909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a71a855e-9f2c-449c-b7aa-b1d4214e0013 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1283 microversion: 2.1 time: 0.211318 Aug 25 01:28:28.610729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 114/234] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:28 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:28.655824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:28.663102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3bee79bd-2375-4998-a547-df486073609e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.349148 Aug 25 01:28:28.663668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 121/235] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:28 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:29.249167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:29.250186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:29.256509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.256960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.257736 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.258171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.410548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:29.411353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:29.417316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.417761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.418522 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.419007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.553885 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:29.562150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4e5d4e2f-f1be-41d2-9cc4-be9cfa069e0f tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.156611 Aug 25 01:28:29.562729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:29 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:29.622047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:29.622659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:29.628817 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.629261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.630034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.630468 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.752584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:29.762089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c832c3e7-c375-45e6-b878-aacba7f7791a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.143732 Aug 25 01:28:29.762759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 123/237] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:29 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:29.769791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:29.770707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:29.780785 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.781274 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.782061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.782494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.902087 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:29.909305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e73d0e23-3625-43ff-8c57-5f9b31d552ea tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.145484 Aug 25 01:28:29.910455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:29 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:29.914715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-9a370c41-0791-40c4-a765-52dcac09e163 req-f9ccc549-2c86-4112-8bf1-2f4dc337847b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16bcdc99-e6b5-4242-a77b-9908957fc7c9", "tag": "e5f74a04-7e2e-4039-9b3d-fb3695831c47"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:29.916219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:29.916219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:28:29.922387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9a370c41-0791-40c4-a765-52dcac09e163 req-f9ccc549-2c86-4112-8bf1-2f4dc337847b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:29.922866 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9a370c41-0791-40c4-a765-52dcac09e163 req-f9ccc549-2c86-4112-8bf1-2f4dc337847b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:29.933077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-9a370c41-0791-40c4-a765-52dcac09e163 req-f9ccc549-2c86-4112-8bf1-2f4dc337847b service nova] Creating event network-changed:e5f74a04-7e2e-4039-9b3d-fb3695831c47 for instance 16bcdc99-e6b5-4242-a77b-9908957fc7c9 on hv-cinder-79001 Aug 25 01:28:29.937623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-9a370c41-0791-40c4-a765-52dcac09e163 req-f9ccc549-2c86-4112-8bf1-2f4dc337847b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026062 Aug 25 01:28:29.938162 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 125/239] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:30.579959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:30.580757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:30.586820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.587250 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:30.588008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.588443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:30.710869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:30.718299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5ad78975-b2ff-4bbc-ba8c-4077280d0fc7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.142761 Aug 25 01:28:30.718858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 126/240] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:30 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:30.779688 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:30.780308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:30.786523 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.787067 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:30.787843 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.788280 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:30.908832 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:30.916482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d508daa4-2939-4996-8baf-68c0fbcdcbb3 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.140585 Aug 25 01:28:30.917031 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 127/241] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:30 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:30.926528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:30.927239 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:30.932946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.933424 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:30.934192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:30.934632 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:31.053584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:31.060928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-691e952b-8f80-4835-86ff-ad6d0aa6a297 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.138341 Aug 25 01:28:31.061488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 128/242] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:30 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:31.734198 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:31.734844 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:31.741530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:31.741980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:31.742766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:31.743205 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:31.866890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:31.874058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-621ba21f-54a1-42f3-a854-ddd5daa7f767 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.143499 Aug 25 01:28:31.874611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 129/243] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:31 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:31.935124 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:31.935732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:31.941287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:31.941769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:31.942527 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:31.942988 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:32.058172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:32.065300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e6726831-509c-4816-8713-e61b67c9f859 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.133538 Aug 25 01:28:32.065860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 130/244] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:31 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:32.078861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:32.079470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:32.085305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:32.085752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:32.086519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:32.086985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:32.201520 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:32.210219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c890b047-9fcd-4fb1-b731-f6677039ae5f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.134581 Aug 25 01:28:32.210826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 131/245] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:32 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:32.238049 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9f6a86ec-2814-40aa-b0fd-8e6d3cbcf274 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 2.992370 Aug 25 01:28:32.241719 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 115/246] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:29 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 2994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:32.890894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:32.892137 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:32.898693 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:32.899168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:32.899952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:32.900390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.043481 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:33.051476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-351b7c96-da24-47c3-85dd-b061f882c470 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.164453 Aug 25 01:28:33.052131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 132/247] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:32 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:33.081688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:33.082326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:33.088717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.089167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.089934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.090367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.212214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:33.219645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ee72e004-daca-4ded-83fa-3a97cca468cf tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.142058 Aug 25 01:28:33.220214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 116/248] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:33 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:33.234311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:33.235039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:33.241533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.241986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.242780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.243218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.249583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:33.250494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:33.257565 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.258031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.259231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.259231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.373692 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:33.381956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b033f565-65eb-469e-b1a2-0fce35f32b25 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.151276 Aug 25 01:28:33.390704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 133/249] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:33 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:33.402151 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-abb74dc0-b570-4d32-a214-7c3a1a3ef651 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 0.155911 Aug 25 01:28:33.403213 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 117/250] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:33 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:33.428825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-c8964390-d279-4443-9cdb-3130cfb9c063 req-42ee9098-d573-4a03-9be5-7ab5822257eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1404c2e2-44fe-4f62-a42d-7bc0efc978ac", "tag": "b2b2a937-b3a3-4daf-a59f-7611bf87221c"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:33.431836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:33.431836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:28:33.441485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c8964390-d279-4443-9cdb-3130cfb9c063 req-42ee9098-d573-4a03-9be5-7ab5822257eb service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:33.453197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c8964390-d279-4443-9cdb-3130cfb9c063 req-42ee9098-d573-4a03-9be5-7ab5822257eb service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:33.466189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-c8964390-d279-4443-9cdb-3130cfb9c063 req-42ee9098-d573-4a03-9be5-7ab5822257eb service nova] Creating event network-changed:b2b2a937-b3a3-4daf-a59f-7611bf87221c for instance 1404c2e2-44fe-4f62-a42d-7bc0efc978ac on hv-cinder-79001 Aug 25 01:28:33.473087 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-c8964390-d279-4443-9cdb-3130cfb9c063 req-42ee9098-d573-4a03-9be5-7ab5822257eb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048921 Aug 25 01:28:33.473682 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 134/251] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:34.069455 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:34.070154 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:34.076436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.076881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.077635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.078059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.198890 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:34.206098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f90aa1aa-687d-4f6d-a764-bf77d1cd90c7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.141701 Aug 25 01:28:34.206877 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 118/252] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:34 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:34.237256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:34.238575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:34.244610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.245121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.245956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.246466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.365272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:34.372455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-31e16a9f-c936-428c-a2ec-f131572a23bd tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.139217 Aug 25 01:28:34.373007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 135/253] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:34 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:34.398711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:34.399330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:34.405141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.405589 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.406347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.406807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.414190 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:34.415241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:34.421098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.421726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.422634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:34.423270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:34.535046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:34.542835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a20c97cc-0afb-45bf-88b4-bd41a7b72fa6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.147768 Aug 25 01:28:34.543398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 119/254] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:34 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:35.222898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:35.223912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:35.230887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.231544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.232480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.232908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.360466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:35.368405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c2b52643-7341-432a-85cf-6095d9981921 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.149755 Aug 25 01:28:35.369453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 120/255] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:35 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:35.389363 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:35.390258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:35.397544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.398197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.399222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.399797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.532786 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:35.540415 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-621208f8-f340-4db0-9b59-f81b55f3421d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.155024 Aug 25 01:28:35.541066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 121/256] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:35 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:35.559975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:35.560753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:35.567332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.568017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.568847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:35.569347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:35.699979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:35.710652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6c1463a5-6784-470e-97c0-e9a599783551 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.154217 Aug 25 01:28:35.720994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 122/257] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:35 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:36.385103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:36.385770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:36.392055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.392654 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:36.393558 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.394084 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:36.514165 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:36.521888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a9014c57-04b7-433f-85d3-79766ce9a86c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.140582 Aug 25 01:28:36.522541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 123/258] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:36 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:36.557835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:36.558448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:36.564951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.565396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:36.566220 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.566654 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:36.733644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:36.741188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-12e19599-c0f6-488a-a893-587621dc02e4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.187132 Aug 25 01:28:36.750805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 124/259] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:36 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:36.755555 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:36.756171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:36.763490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.764190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:36.764969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:36.765405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:37.014824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-911923b8-da40-4a41-a171-1d916abc87da tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 2.604176 Aug 25 01:28:37.016573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 136/260] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:34 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 2607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:37.115337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:37.124278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-de404123-c0d0-43ad-8ded-5b179471958a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.372342 Aug 25 01:28:37.131929 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 125/261] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:36 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:37.544831 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:37.546220 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:37.555056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:37.555833 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:37.556870 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:37.557937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:37.699803 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:37.708681 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1f75d373-c830-43e7-b81a-e12759c966ca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.172555 Aug 25 01:28:37.709362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 137/262] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:37 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:37.757683 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:37.758276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:37.766524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:37.766639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:37.767424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:37.768044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:37.939834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:37.947581 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0ff7af75-6679-44cd-89ec-93038c26983d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.193902 Aug 25 01:28:37.948449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 126/263] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:37 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:38.027625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:38.028521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:38.036585 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.037035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.037809 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.038256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.116575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d1311d0d-a6de-4a54-9623-f7446c5186ef tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 0.092093 Aug 25 01:28:38.117237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 138/264] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:38 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:38.141941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:38.143086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:38.152068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.152785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.154499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.155130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.382649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:38.395059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d8c0ba75-9e48-4217-b20b-bba28a97afe5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.255501 Aug 25 01:28:38.396939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 127/265] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:38 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:38.727230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:38.729561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:38.741630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.742089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.742955 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.743393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.911697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:38.920757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fb80dd80-c1d9-4379-abc9-2b60004782b6 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.198715 Aug 25 01:28:38.921664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 139/266] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:38 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:38.965322 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:38.966035 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:38.972748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.973768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:38.974571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:38.975671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.128042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:39.129941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:39.137285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:39.149554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a2033e91-3119-42d0-812d-c3764510aa87 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.186090 Aug 25 01:28:39.150754 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.151493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 128/267] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:38 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:39.162645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.163757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.164422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.413137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:39.413756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:39.420291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.420743 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.421532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.421970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.599979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:39.609654 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9e23030b-d32f-447a-8624-a14b505de222 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.200428 Aug 25 01:28:39.621452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 129/268] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:39 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:39.937807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:39.938647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:39.945216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.945842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:39.946535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:39.947013 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:40.075945 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:40.083823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8c2ae627-1847-4a7a-888b-9b9fb444354c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.149882 Aug 25 01:28:40.084392 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 130/269] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:39 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:40.168216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:40.169052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:40.176631 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:40.177100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:40.178052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:40.178344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:40.307096 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:40.315427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f34fbee6-c8a9-49bd-b504-478b6f52b164 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.150845 Aug 25 01:28:40.316750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 131/270] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:40 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:40.629093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:40.630000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:40.636880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:40.637540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:40.640175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:40.640791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:40.848800 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:40.857670 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-23baeb2d-f51b-4202-a732-47872d89fd11 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.233891 Aug 25 01:28:40.858260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 132/271] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:40 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:41.100904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:41.101568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:41.107562 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.107994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:41.109068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.109699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:41.325600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:41.334575 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-05bedc3d-3e79-49c0-b025-fbfc8d17a7b9 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.237762 Aug 25 01:28:41.347528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 133/272] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:41 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:41.352715 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:41.353404 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:41.365452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.365996 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:41.367031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.367652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:41.591390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:41.602757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d4f887bb-0702-45d3-b02c-4281af171882 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.253425 Aug 25 01:28:41.604223 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 134/273] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:41 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:41.885082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:41.886977 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:41.896672 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.897398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:41.898488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:41.899319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:42.138067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:42.145756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-701f1b7c-869c-401c-9a6a-d233351f8227 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1523 microversion: 2.1 time: 0.273390 Aug 25 01:28:42.146326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 135/274] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:41 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:42.366307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:42.367396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:42.374953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:42.375620 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:42.377275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:42.377869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:42.443975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b36c8b1a-8778-4156-9377-729ed5cde878 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28145 microversion: 2.1 time: 3.319775 Aug 25 01:28:42.445789 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 140/275] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:39 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28145 bytes in 3322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:42.621627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:42.633473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:42.653773 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:42.654935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:42.656463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:42.657122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:42.857012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:42.866005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9e44aa20-56fc-4f3f-b1c6-6b8a6eaecb10 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.506040 Aug 25 01:28:42.866707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 136/276] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:42 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:42.907816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:42.915779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aa25f4e2-9661-455f-8fa7-9385b68ea16e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.298491 Aug 25 01:28:42.916370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 141/277] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:42 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:43.162777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:43.163397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:43.170803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.171263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.174669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.176525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.333834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:43.344817 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-03df9b47-cb32-4f15-ab04-3c477d127999 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1503 microversion: 2.1 time: 0.186528 Aug 25 01:28:43.345965 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 137/278] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:43 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:43.368440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:43.369049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:43.376076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.376994 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.378037 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.378734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.459266 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:43.460970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:43.469017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.469700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.472806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.473410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.577417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:43.585994 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c685eab2-f697-410d-83e4-7599ddbd5f1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1516 microversion: 2.1 time: 0.220567 Aug 25 01:28:43.586588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 142/279] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:43 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:43.621071 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a544478d-c42e-4062-a05c-18877ac69b5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28394 microversion: 2.1 time: 0.168141 Aug 25 01:28:43.622261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 138/280] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:43 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28394 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:43.894499 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:43.895150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:43.904188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.904635 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.905408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.905839 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.934371 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:43.935101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:43.944039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.945543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:43.946423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:43.948385 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:44.266784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:44.276287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c032e717-b557-4fd4-a1bb-c6644e667beb tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.385704 Aug 25 01:28:44.277538 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 143/281] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:43 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:44.311065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:44.319660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c2ace43d-8450-400f-80b7-081e8ab53a15 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.389715 Aug 25 01:28:44.320217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:43 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:44.633127 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:44.634308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:44.652578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:44.653158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:44.654163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:44.655021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:44.785624 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-378c126d-0270-4a2f-b5f0-fdfaf2f09147 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28431 microversion: 2.1 time: 0.156213 Aug 25 01:28:44.786626 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 144/283] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:44 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28431 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:44.897469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-5750c7f4-f5b5-4760-b2f7-db6e079bf01a req-b39d228a-96ba-4339-9882-bb0158eee555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16bcdc99-e6b5-4242-a77b-9908957fc7c9", "name": "network-vif-plugged", "status": "completed", "tag": "e5f74a04-7e2e-4039-9b3d-fb3695831c47"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:44.899608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:44.899608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:28:44.911312 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-5750c7f4-f5b5-4760-b2f7-db6e079bf01a req-b39d228a-96ba-4339-9882-bb0158eee555 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:44.911751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-5750c7f4-f5b5-4760-b2f7-db6e079bf01a req-b39d228a-96ba-4339-9882-bb0158eee555 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:44.939936 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-5750c7f4-f5b5-4760-b2f7-db6e079bf01a req-b39d228a-96ba-4339-9882-bb0158eee555 service nova] Creating event network-vif-plugged:e5f74a04-7e2e-4039-9b3d-fb3695831c47 for instance 16bcdc99-e6b5-4242-a77b-9908957fc7c9 on hv-cinder-79001 Aug 25 01:28:44.949247 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-5750c7f4-f5b5-4760-b2f7-db6e079bf01a req-b39d228a-96ba-4339-9882-bb0158eee555 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055457 Aug 25 01:28:44.950768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 140/284] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:28:45.203686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:45.205059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:45.212944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.213464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.214518 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.215129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.254253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lazy-loading 'flavor' on Instance uuid af8070a9-ffcd-46c1-b623-321a89e97512 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:28:45.324763 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:45.326180 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:45.337667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.338382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.339509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.340174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.549029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-570a630b-0a76-40ff-922a-7d5f2595face tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action" status: 200 len: 32 microversion: 2.1 time: 0.351536 Aug 25 01:28:45.553818 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 145/285] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:45 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:28:45.562122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:45.564166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:45.587719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.588404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.589641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.590341 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.799113 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:45.810401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fb9073de-9e24-455e-b860-3c2b887efa1d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.519091 Aug 25 01:28:45.811646 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:45 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:45.836121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:45.837311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:45.849531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.849985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:45.854583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:45.855228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:46.052952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:46.064611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-23a71e74-ab51-4147-a995-c80f73ee901e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.511882 Aug 25 01:28:46.067503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 146/287] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:45 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:46.099506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:46.107021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:46.132216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:46.137335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:46.138310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:46.140254 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:46.170620 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:46.182601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bd774961-1d1b-492c-b85e-b8c88f63631f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.367429 Aug 25 01:28:46.183246 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 142/288] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:45 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:46.360390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a3f51079-4cb2-4343-b6d4-1308eba0a9fc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.282774 Aug 25 01:28:46.365214 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 147/289] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:46 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:46.635506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Action: 'create', calling method: .version_select at 0x7fd58dd6a3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-225380796"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:46.667535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:28:46.673586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for user 31c9651dc204465eb9038c903a08910f and project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:28:46.828956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:46.830013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:46.856875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:46.858438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:46.859585 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:46.860411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.092302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:47.105258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-391749f2-cf73-4928-bda3-94ee739db17a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1318 microversion: 2.1 time: 0.280982 Aug 25 01:28:47.107121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 148/290] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:46 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:47.115755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:47.117964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:47.124636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.125389 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.126806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.127450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.344718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:47.344937 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:28:47.349309 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for user 31c9651dc204465eb9038c903a08910f and project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:28:47.366272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6120f337-0fc4-4acc-8a9b-16f5e035d37e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.257293 Aug 25 01:28:47.367446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 149/291] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:47 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:47.368359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-98762c37-26bd-42eb-b712-3389c7ae6406 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.052370 Aug 25 01:28:47.374597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 143/292] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Aug 25 01:28:46 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:47.380489 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:47.383322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:47.385734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:47.386658 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:47.390220 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.390778 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.391647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.392143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.397099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.397698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.398589 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:47.399284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:47.555028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-587dd1dd-3403-472e-ab8f-3c5eff384238 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.178861 Aug 25 01:28:47.555695 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 144/293] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:47 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:47.566595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:47.575029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ae7bbbd6-3559-49d1-a209-5de637d5244b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.205927 Aug 25 01:28:47.576109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 150/294] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:47 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:48.124077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:48.124916 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:48.138100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.138582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.140709 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.142699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.382350 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:48.389164 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:48.390115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:48.392489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-66c5428d-0c70-4bb0-b2e0-3d0b38181427 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1507 microversion: 2.1 time: 0.272829 Aug 25 01:28:48.394058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:48 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:48.398414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.399108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.400261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.400898 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.575011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:48.576895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:48.595968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.596665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.597849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.598540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.615683 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:48.627298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d115d48b-e836-4eea-9568-d0bbb9987d3c tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.246404 Aug 25 01:28:48.628881 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:48 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:48.635547 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:48.636686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:48.644524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.645358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.646653 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:48.647360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:48.885447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:48.903998 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a2c2cd56-eae5-47b7-b5cc-0126852dccf8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.273346 Aug 25 01:28:48.904588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 152/297] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:48 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:49.645625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:49.646294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:49.652356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:49.652804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:49.653596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:49.654015 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:49.783735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:49.791098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9726eb7f-61d9-47be-8181-5c3240cb584d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.149761 Aug 25 01:28:49.791652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 153/298] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:49 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:49.921936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:49.922735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:49.929672 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:49.930199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:49.931118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:49.931622 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:50.056163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:50.063720 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4e4344cc-0c97-479b-924f-bd899d0f0600 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.145530 Aug 25 01:28:50.064367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 154/299] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:49 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:50.663313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-865bcb4f-6e58-4686-844b-dc70fb4fcb3e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 2.100236 Aug 25 01:28:50.663969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 146/300] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:48 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:50.807183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:50.807793 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:50.814377 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:50.814857 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:50.816275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:50.816716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:50.867950 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-7272126d-c938-4e01-bf71-cdd43cc4172d req-b77f9381-c960-411f-9e25-215904ee3c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1404c2e2-44fe-4f62-a42d-7bc0efc978ac", "name": "network-vif-plugged", "status": "completed", "tag": "b2b2a937-b3a3-4daf-a59f-7611bf87221c"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:50.870463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:28:50.870463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:28:50.881842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-7272126d-c938-4e01-bf71-cdd43cc4172d req-b77f9381-c960-411f-9e25-215904ee3c52 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:50.882625 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-7272126d-c938-4e01-bf71-cdd43cc4172d req-b77f9381-c960-411f-9e25-215904ee3c52 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:50.895509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-7272126d-c938-4e01-bf71-cdd43cc4172d req-b77f9381-c960-411f-9e25-215904ee3c52 service nova] Creating event network-vif-plugged:b2b2a937-b3a3-4daf-a59f-7611bf87221c for instance 1404c2e2-44fe-4f62-a42d-7bc0efc978ac on hv-cinder-79001 Aug 25 01:28:50.901481 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-7272126d-c938-4e01-bf71-cdd43cc4172d req-b77f9381-c960-411f-9e25-215904ee3c52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037874 Aug 25 01:28:50.902291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 147/301] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:28:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:28:50.954264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:50.964075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7268ddfe-9a82-4aaf-bf6b-a2afe43bf26d tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.160501 Aug 25 01:28:50.971492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 155/302] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:50 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:51.083176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:51.084034 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:51.090865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.091703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:51.092603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.093168 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:51.222153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:51.229378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5ae7a1e8-c025-4e6e-b22c-57867174c2dd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.150414 Aug 25 01:28:51.229923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 148/303] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:51 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:51.674880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:51.675879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:51.681628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.682022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:51.682815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.683256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:51.980448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:51.981026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:51.987245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.987686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:51.988436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:51.988864 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:52.106544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:52.113600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c0130527-687b-46ae-89a6-c27675c3702b tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.136854 Aug 25 01:28:52.114153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 149/304] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:51 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:52.246647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:52.247214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:52.252677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:52.253116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:52.254462 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:52.254922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:52.368544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:52.375713 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-80b3fbce-7279-4754-aee6-4216f6c9bd3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.132433 Aug 25 01:28:52.376289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 150/305] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:52 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:53.128883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:53.129520 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:53.135344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:53.135792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:53.136550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:53.136979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:53.258277 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:53.265719 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-308100fc-767d-40c8-8289-32ada97d58a4 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.140450 Aug 25 01:28:53.266278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 151/306] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:53 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:53.427043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:53.427650 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:53.433186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:53.433632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:53.434387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:53.434847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:53.553955 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:53.561111 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5996bdae-4422-401f-a59c-960e15813851 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.137498 Aug 25 01:28:53.561666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 152/307] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:53 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:54.282542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:54.283175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:54.290166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:54.290611 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:54.291416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:54.291849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:54.408336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:54.416026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bbf81458-7a9a-4c94-a380-c972700da4ac tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.137114 Aug 25 01:28:54.416580 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 153/308] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:54 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:54.477174 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c6e2c45d-824b-4114-b576-da1448b61acf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 2.805748 Aug 25 01:28:54.477804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 156/309] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:51 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 2807 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:54.579072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:54.580379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:54.587753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:54.587753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:54.588621 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:54.589309 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:54.712969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:54.722778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a5f9c08c-80a8-4407-8939-a9e2cb0d8e1d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.147499 Aug 25 01:28:54.726559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 154/310] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:54 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:55.433202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:55.433811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:55.440289 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.440747 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.442161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.442598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.492366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:55.493379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:55.499292 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.499806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.500634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.501133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.566415 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:55.573510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d1b5c7fd-c7aa-4b11-9724-2c7f9d39eb48 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1313 microversion: 2.1 time: 0.144407 Aug 25 01:28:55.574056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 157/311] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:55 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:55.588200 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-92f71aa5-e136-4408-9b3b-8f3ed4ccc726 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.102614 Aug 25 01:28:55.588822 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 155/312] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:55 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:55.740710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:55.741568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:55.747706 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.748158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.748933 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:55.749543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:55.882051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:55.889503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-164381d9-1993-4c97-a8c0-4727340916db tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.153210 Aug 25 01:28:55.890061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 158/313] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:55 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:56.265117 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4c9ba6-d2c1-42dc-9593-643ec6906dda"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:56.266246 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:56.273091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.273535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.274286 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.274746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.514833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-da539635-4659-470e-b382-fc9121df5a01 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253755 Aug 25 01:28:56.515519 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 156/314] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:28:56 2021] POST /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:28:56.588900 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:56.589505 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:56.596072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.596591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.597575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.598015 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.600224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:56.601147 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:56.607930 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.608373 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.609128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.609556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.699398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6b46f5a3-9b2b-49b7-823d-c0928de06a14 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.103300 Aug 25 01:28:56.700960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 157/315] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:56 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:28:56.727850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:56.735225 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-afc0fa27-ad96-4837-b22a-47542f8bfa6a tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1498 microversion: 2.1 time: 0.149939 Aug 25 01:28:56.735778 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 159/316] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:56 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:56.907137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:56.907829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:56.914348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.914823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:56.915585 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:56.916015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.042447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:57.049763 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8efcb79e-7d0a-486c-965b-2d829c9834c9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.146773 Aug 25 01:28:57.050949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 158/317] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:56 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:57.711771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:57.712866 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:57.719085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.719531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.720281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.720708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.799188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-733443ed-504e-47de-ba78-1510ed871a02 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.091339 Aug 25 01:28:57.799812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 160/318] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:57 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:57.861845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:57.863344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:57.874202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.874653 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.875472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.875909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.902228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:28:57.978637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1cfd4ca4-83b4-4189-8a0e-05c7d031f8f5 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 204 len: 0 microversion: 2.1 time: 0.122075 Aug 25 01:28:57.979231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 159/319] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:28:57 2021] DELETE /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:28:57.987823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:57.988510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:57.994804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.995248 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:57.995996 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:57.996422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:58.067316 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:58.068074 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:58.074405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:58.074922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:58.075690 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:58.076307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:58.129901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:58.139057 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5c52e323-439e-48c6-8b3e-9789c05d441e tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1504 microversion: 2.1 time: 0.154959 Aug 25 01:28:58.139675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 161/320] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:57 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:58.205515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:58.212722 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a5fd7aac-94fd-46d4-80eb-fb3749086ff7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.150127 Aug 25 01:28:58.213273 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 160/321] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:58 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:28:58.813277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:58.814349 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:58.820939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:58.821388 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:58.822246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:58.823004 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:58.936840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fa8aa467-9fbb-4bb8-af13-cc7d7a2128fe tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.129151 Aug 25 01:28:58.937514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 162/322] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:58 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:28:59.157276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:59.157894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:59.164292 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.164740 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:59.165509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.165938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:59.230301 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:28:59.231207 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:59.238397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.238983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:59.239632 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.240080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:59.306325 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:59.313564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ca7ae6bb-cdff-4c52-8d73-22175bf1f486 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1504 microversion: 2.1 time: 0.159984 Aug 25 01:28:59.314118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 161/323] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:59 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:59.381238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:28:59.388467 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0cf17400-e7bc-43d4-bb4f-1d07cdca47b0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.162375 Aug 25 01:28:59.389319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 163/324] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:28:59 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:28:59.949157 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:28:59.950332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:28:59.956617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.957068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:28:59.957835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:28:59.958279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:00.063863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c3de13bd-abb7-4501-a70d-10e05f37003e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.118599 Aug 25 01:29:00.067812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 162/325] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:28:59 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:00.330437 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:00.331198 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:00.338302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:00.338872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:00.339887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:00.340520 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:00.407922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:00.411679 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:00.425679 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:00.429486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:00.431703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:00.436956 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:00.595476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:00.611872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-991aeb7a-b53b-4ef4-9f52-c2471d0aaf91 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1504 microversion: 2.1 time: 0.285037 Aug 25 01:29:00.619308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 164/326] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:00 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:00.627230 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:00.638491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b6f5ccd8-28b3-4e0f-8d7e-501a30559111 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.236532 Aug 25 01:29:00.639886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 163/327] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:00 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:01.056589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-de8c26b4-ec2f-4dd0-b5da-f746b8a3a38f req-222cbac5-d6ab-42a5-a0a6-efc0e61b0699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1404c2e2-44fe-4f62-a42d-7bc0efc978ac", "name": "network-vif-deleted", "tag": "b2b2a937-b3a3-4daf-a59f-7611bf87221c"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:01.058815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:29:01.058815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:29:01.070028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-de8c26b4-ec2f-4dd0-b5da-f746b8a3a38f req-222cbac5-d6ab-42a5-a0a6-efc0e61b0699 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.070563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-de8c26b4-ec2f-4dd0-b5da-f746b8a3a38f req-222cbac5-d6ab-42a5-a0a6-efc0e61b0699 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.076068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:01.077007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:01.083744 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.084007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-de8c26b4-ec2f-4dd0-b5da-f746b8a3a38f req-222cbac5-d6ab-42a5-a0a6-efc0e61b0699 service nova] Creating event network-vif-deleted:b2b2a937-b3a3-4daf-a59f-7611bf87221c for instance 1404c2e2-44fe-4f62-a42d-7bc0efc978ac on hv-cinder-79001 Aug 25 01:29:01.084198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.084975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.085397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.089030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-de8c26b4-ec2f-4dd0-b5da-f746b8a3a38f req-222cbac5-d6ab-42a5-a0a6-efc0e61b0699 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036355 Aug 25 01:29:01.089620 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 165/328] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:01.163931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5deebe18-7286-4dda-ac6b-c48f2928b021 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.091846 Aug 25 01:29:01.164597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 164/329] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:01 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:01.632345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:01.633083 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:01.639463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.639917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.640684 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.641122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.657861 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:01.658845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:01.665396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.665836 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.666829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.667260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.672800 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:01.673253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:01.673696 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lazy-loading 'fault' on Instance uuid 1404c2e2-44fe-4f62-a42d-7bc0efc978ac {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:29:01.739928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f46b66092d4bc8956f979530a04ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d509ebf5e5a4a77820b0e5ea04090c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:01.751390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bd3c1d02-8e73-4bd9-82e0-e77c88133980 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 200 len: 1303 microversion: 2.1 time: 0.122893 Aug 25 01:29:01.752133 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 166/330] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:01 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:01.845122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:01.853146 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ae4ec76c-6997-44b2-8a21-297366bcd72a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.199564 Aug 25 01:29:01.853707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 165/331] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:01 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:02.177360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:02.178269 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:02.184281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.184772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:02.185782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.186293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:02.261990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fd16c2f2-f46c-4006-a391-b0b5b5e33bf3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.087875 Aug 25 01:29:02.264169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 167/332] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:02 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:02.768103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:02.768791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] [instance: 1404c2e2-44fe-4f62-a42d-7bc0efc978ac] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:02.775860 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.776479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:02.777607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.778215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:02.791520 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] HTTP exception thrown: Instance 1404c2e2-44fe-4f62-a42d-7bc0efc978ac could not be found. Aug 25 01:29:02.792118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] Returning 404 to user: Instance 1404c2e2-44fe-4f62-a42d-7bc0efc978ac could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:29:02.792973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a99a2e21-b46d-4e07-8f1c-02ba92b542b8 tempest-VolumesActionsTest-1373764701 tempest-VolumesActionsTest-1373764701-project] 10.222.0.23 "GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac" status: 404 len: 111 microversion: 2.1 time: 0.028512 Aug 25 01:29:02.793493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 166/333] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:02 2021] GET /compute/v2.1/servers/1404c2e2-44fe-4f62-a42d-7bc0efc978ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:29:02.871132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:02.872569 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:02.890510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.891121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:02.892306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:02.893068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:03.052516 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:03.060892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-855087d9-3241-4f27-aef7-d18fe7c051e1 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.194796 Aug 25 01:29:03.062035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 168/334] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:02 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:03.274994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:03.276086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:03.296942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:03.297397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:03.298223 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:03.298606 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:03.397306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-85de5a7a-aa0b-4f70-9896-5d3178dcbf56 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.127552 Aug 25 01:29:03.397935 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 167/335] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:03 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:04.065601 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d4c9ba6-d2c1-42dc-9593-643ec6906dda"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:04.066671 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:04.072917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.073358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.074108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.074536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.081328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:04.082100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:04.088526 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.089061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.089898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.090398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.156370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Invalid volume: volume 3d4c9ba6-d2c1-42dc-9593-643ec6906dda is already attached to instances: 16bcdc99-e6b5-4242-a77b-9908957fc7c9 Aug 25 01:29:04.157160 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 400 to user: Invalid volume: volume 3d4c9ba6-d2c1-42dc-9593-643ec6906dda is already attached to instances: 16bcdc99-e6b5-4242-a77b-9908957fc7c9 {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:29:04.158182 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e75a156a-6d71-4cbb-89ac-27f27b57d80c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096386 Aug 25 01:29:04.158741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 169/336] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:29:04 2021] POST /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:29:04.212660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:04.219812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c15c677e-66ff-4d74-873d-b7d28fc87005 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.142478 Aug 25 01:29:04.220370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 168/337] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:04 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:04.254420 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:04.254939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:04.260784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.261225 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.261966 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.262390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.349714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lazy-loading 'services' on Instance uuid 16bcdc99-e6b5-4242-a77b-9908957fc7c9 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:29:04.409295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:04.411680 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:04.412110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-489c3c5c-60a3-466f-b235-1f93f228d02d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments/3d4c9ba6-d2c1-42dc-9593-643ec6906dda" status: 202 len: 0 microversion: 2.1 time: 0.161174 Aug 25 01:29:04.412677 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 170/338] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:29:04 2021] DELETE /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments/3d4c9ba6-d2c1-42dc-9593-643ec6906dda => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:29:04.418655 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.419510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.420313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.420746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.421178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:04.422249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:04.428455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.428929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.429762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:04.430213 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:04.462370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-75c37f58-b84b-44be-af23-9ce26f9249c4 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 25 01:29:04.462879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 171/339] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:04 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:29:04.499459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-77126e1f-7c2e-486d-9d3f-084ecbf43180 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28595 microversion: 2.1 time: 0.093765 Aug 25 01:29:04.503303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 169/340] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:04 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28595 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:05.236768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:05.237440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:05.243597 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.244046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.244779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.245210 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.370113 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:05.377301 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-34e55b49-475c-44ee-92e5-f4468a138b19 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.144264 Aug 25 01:29:05.377846 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 172/341] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:05 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:05.474461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:05.475479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:05.481914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.482365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.483182 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.483620 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.512178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:05.514736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:05.524670 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.525143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.525929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:05.528972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:05.536940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1288b871-9e8c-4774-b635-1b1bd4d7a545 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067067 Aug 25 01:29:05.537694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 170/342] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:05 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:05.629228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a446e274-f326-47ba-90bd-7bc3c96afa81 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 28730 microversion: 2.1 time: 0.121948 Aug 25 01:29:05.629872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 173/343] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:05 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 28730 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:06.393291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:06.393803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:06.399517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.399964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.400711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.401177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.526586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:06.533712 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0b7f193e-7a2f-43af-a33c-60825e7148fd tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.144219 Aug 25 01:29:06.534257 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 171/344] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:06 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:06.548742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:06.549760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:06.558334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.559143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.560538 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.561319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.595780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ccfbbae9-4e30-4e5e-9f00-469918fccff0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051306 Aug 25 01:29:06.596329 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 174/345] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:06 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:29:06.640940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:06.641880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:06.653118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.653118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.653118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:06.653118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:06.746422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-629484597", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "400a2ac9-3eb3-4dc0-9993-b410ce65adf5"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:06.752310 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e6388190-6e04-48c6-8207-68e84826115f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 29757 microversion: 2.1 time: 0.115183 Aug 25 01:29:06.753064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 172/346] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:06 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 29757 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:07.550872 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:07.551569 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:07.558365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:07.558833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:07.559596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:07.560026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:07.681603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:07.688755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9e4bffe5-98f2-44f3-bc34-2a33e54ab5f8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.142055 Aug 25 01:29:07.689308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 173/347] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:07 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:07.764331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:07.765168 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:07.771587 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:07.772034 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:07.772794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:07.773229 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:07.858993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2f202ec3-131e-4f6b-8d0b-9b2f6febfcdf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 30693 microversion: 2.1 time: 0.098207 Aug 25 01:29:07.859628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 174/348] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:07 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 30693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:08.705525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:08.706222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:08.713233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:08.713681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:08.714450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:08.714914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:08.832158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:08.839883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3fd5b2d3-0cab-481d-a799-51ea0bea2151 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.138320 Aug 25 01:29:08.840439 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 175/349] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:08 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:08.870192 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:08.871124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:08.876748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:08.877196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:08.877957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:08.878387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:08.961521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ad5caf2a-d436-46eb-8d16-c236db4579d7 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 31781 microversion: 2.1 time: 0.094414 Aug 25 01:29:08.962709 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 176/350] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:08 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 31781 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:09.857596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:09.858319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:09.864684 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:09.865678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:09.866429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:09.866957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:10.000716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:10.012417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2d7f9c04-7516-4e57-859f-4de9b58b586d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.158686 Aug 25 01:29:10.014414 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 177/351] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:09 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:10.027994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:10.029193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:10.035742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:10.036195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:10.037699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:10.038138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:10.134300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7dcb38dd-c7ed-4914-95cb-dcf963f71d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 32792 microversion: 2.1 time: 0.118408 Aug 25 01:29:10.134946 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 178/352] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:10 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 32792 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:11.031153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:11.031749 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:11.038150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:11.038603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:11.039824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:11.040263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:11.167725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:11.174891 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-297c0b9a-3605-49a5-9469-a931b8d99d57 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.148062 Aug 25 01:29:11.175449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 179/353] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:11 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:11.179677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:11.180560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:11.185777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:11.186227 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:11.187020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:11.187456 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:13.731954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-15f7c4a1-94a4-4d84-b86e-5a6b2eb15036 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 34301 microversion: 2.1 time: 2.555232 Aug 25 01:29:13.732648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 180/354] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:11 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 34301 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:29:13.737900 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:13.738853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:13.750908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:13.753067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:13.754566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:13.756221 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:13.878011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:13.885209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8b137573-8b80-4796-83b8-fb57f584525e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.151500 Aug 25 01:29:13.885765 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 181/355] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:13 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:14.744879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:14.745783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:14.752161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:14.752642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:14.753406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:14.753838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:14.834090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-571f68c4-0e03-4395-ace4-2de44a895ba1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 34965 microversion: 2.1 time: 0.092628 Aug 25 01:29:14.834624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 182/356] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:14 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 34965 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:14.902853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:14.903791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:14.911421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:14.911865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:14.912647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:14.913076 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:15.035217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:15.042939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a9952a12-2964-4721-8705-4cacb9420008 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.144439 Aug 25 01:29:15.043500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 183/357] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:14 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:15.845462 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:15.846474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:15.852965 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:15.853406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:15.854395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:15.854801 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:15.932860 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-54f98208-49b9-48c6-955b-aa2a87bbbaa5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 35615 microversion: 2.1 time: 0.091076 Aug 25 01:29:15.933495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 184/358] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:15 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 35615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:16.059975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:16.060594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:16.066953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:16.067403 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:16.068159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:16.068590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:16.192080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:16.200509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d9a2c17f-69a1-4bdc-bdc7-76de4af0999c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.144416 Aug 25 01:29:16.201112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 185/359] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:16 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:16.946041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:16.946855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:16.953356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:16.954221 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:16.955030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:16.955463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:17.039378 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fbdb9d8a-a030-44ae-b110-c26aa58f0d5c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 36597 microversion: 2.1 time: 0.098370 Aug 25 01:29:17.040013 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 186/360] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:16 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 36597 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:17.218006 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:17.218607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:17.225566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:17.226107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:17.226968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:17.227472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:17.359112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:17.366517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b771e1ed-99f9-4719-9f29-bde6498f2aeb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.152801 Aug 25 01:29:17.367108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 187/361] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:17 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:18.051135 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:18.052544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:18.059044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:18.059607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:18.060386 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:18.060821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:18.159224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-41fc854c-597d-42bc-bdb9-404f3e90e5bf tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 37580 microversion: 2.1 time: 0.111436 Aug 25 01:29:18.160776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 188/362] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:18 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 37580 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:18.383857 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:18.384973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:18.392022 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:18.392471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:18.393298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:18.393857 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:18.518170 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:18.526601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cf2780f1-c2c1-4a81-afd5-a38bc33f8cb7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.146892 Aug 25 01:29:18.527203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 189/363] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:18 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:19.170988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:19.171896 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:19.177693 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:19.178136 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:19.178917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:19.179351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:19.272379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6fdbd77d-1baa-4c9e-8849-245b051512b4 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 38085 microversion: 2.1 time: 0.104909 Aug 25 01:29:19.272978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 190/364] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:19 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 38085 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:19.543854 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:19.545093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:19.551590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:19.551590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:19.552280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:19.552744 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:19.675299 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:19.682697 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ad43a651-f544-42e4-a470-807009bea393 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.142766 Aug 25 01:29:19.683369 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 191/365] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:19 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:20.284270 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:20.285094 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:20.291440 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:20.291883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:20.292642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:20.293073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:20.391411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4b58d71d-5c79-4bca-a724-e2189e10b46e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 38085 microversion: 2.1 time: 0.110642 Aug 25 01:29:20.392061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 192/366] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:20 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 38085 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:20.699863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:20.700557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:20.707030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:20.707479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:20.708739 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:20.709170 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:20.830320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:20.840356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-16a870c2-a4b7-4f0b-8e6c-1e4d36a78238 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.144382 Aug 25 01:29:20.840933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 193/367] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:20 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:20.997185 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] validate_networks() for [('400a2ac9-3eb3-4dc0-9993-b410ce65adf5', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:29:21.367183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:29:21.367921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:29:21.368434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:29:21.368851 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:29:21.369264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:29:21.378200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.378652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.379639 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.380278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.398465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:29:21.403045 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Getting quotas for user d2f7490ad6cf4bed96cfec8a39a65b43 and project 46fe21ec575f40a0b26f9482a77b5a73. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:29:21.404410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:21.405381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:21.413939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.413939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.414779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.415209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.417716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:29:21.420324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:29:21.470928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-28992969-1154-46c4-998b-786908d8f5b1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.728006 Aug 25 01:29:21.471694 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 175/368] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:29:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 14729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 01:29:21.481685 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f3a8c890-8535-4e55-aa19-6bd330edc756 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:21.482302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f3a8c890-8535-4e55-aa19-6bd330edc756 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:21.550643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f3a8c890-8535-4e55-aa19-6bd330edc756 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:21.553150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f3a8c890-8535-4e55-aa19-6bd330edc756 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1217 microversion: 2.1 time: 0.074947 Aug 25 01:29:21.553693 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 176/369] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:21 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:21.857522 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:21.858149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:21.864778 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.865227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.865989 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:21.866474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:21.993303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:22.000383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-349ed029-46be-4c01-9695-ba0af5d25e82 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.146608 Aug 25 01:29:22.000938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 177/370] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:21 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:22.569453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:22.570062 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:22.575812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:22.576265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:22.577032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:22.577470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:22.636347 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:22.643750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5d0ab064-0ac3-4aa3-ba93-d74aaf7bc599 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1221 microversion: 2.1 time: 0.078427 Aug 25 01:29:22.644300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 178/371] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:22 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:23.017148 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:23.017744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:23.023571 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:23.024025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:23.024769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:23.025197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:23.140781 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:23.148032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-628c7288-1a13-4067-baa5-71f9117eb667 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.134711 Aug 25 01:29:23.148587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 179/372] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:23 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:23.660249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:23.660894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:23.667815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:23.668263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:23.669018 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:23.669447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:23.727601 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:23.734652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a2e5fd36-66d9-4362-8a78-4415b088f8d1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1221 microversion: 2.1 time: 0.078106 Aug 25 01:29:23.735229 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 180/373] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:23 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:24.164298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:24.164898 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:24.170704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.171261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.172034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.172473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.290506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:24.297619 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-70f3cfde-0cce-4595-9611-29b8ad4b92e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.137443 Aug 25 01:29:24.298176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 181/374] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:24 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:24.359786 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-765d2506-a050-4f28-84d9-913809f11bb9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 200 len: 38214 microversion: 2.1 time: 2.960104 Aug 25 01:29:24.360972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 194/375] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:21 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 38214 bytes in 2962 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:29:24.372557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:24.373174 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:24.379270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.380130 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.380912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.381419 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.405886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8d928517-e0bf-4661-a209-66a2220c17e2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/ips" status: 200 len: 147 microversion: 2.1 time: 0.037621 Aug 25 01:29:24.406634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 182/376] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:29:24 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:24.751476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:24.752207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:24.759196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.759643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.760406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:24.760842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:24.820290 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:24.827775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-eb762389-1102-4547-9155-7b24ebee253e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1269 microversion: 2.1 time: 0.080236 Aug 25 01:29:24.828398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 195/377] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:24 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:25.315028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:25.315691 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:25.322353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:25.322882 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:25.323713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:25.324155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:25.448261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:25.457075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2c21ff6a-b49b-46ec-84ac-ea92334a4013 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.145775 Aug 25 01:29:25.457715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 183/378] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:25 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:25.845777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:25.847267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:25.857162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:25.859726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:25.861571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:25.863005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:26.053038 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:26.063758 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-644d9d85-ddc8-4fcd-a2b8-afadebf41f48 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.221995 Aug 25 01:29:26.065793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 196/379] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:25 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:26.475135 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:26.475751 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:26.486656 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:26.487479 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:26.488458 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:26.489125 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:26.492104 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-332f8e4b-32c0-47b6-bfb8-4f9d766538f4 req-9e0263d5-8daf-4a24-9754-4aad87842c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c911cb28-8536-4837-949e-328e54ed38cb", "tag": "e6cd8690-974e-4a85-bd2c-284c308dc717"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:26.493712 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:29:26.493712 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:29:26.500781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-332f8e4b-32c0-47b6-bfb8-4f9d766538f4 req-9e0263d5-8daf-4a24-9754-4aad87842c62 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:26.501547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-332f8e4b-32c0-47b6-bfb8-4f9d766538f4 req-9e0263d5-8daf-4a24-9754-4aad87842c62 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:26.514824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-332f8e4b-32c0-47b6-bfb8-4f9d766538f4 req-9e0263d5-8daf-4a24-9754-4aad87842c62 service nova] Creating event network-changed:e6cd8690-974e-4a85-bd2c-284c308dc717 for instance c911cb28-8536-4837-949e-328e54ed38cb on hv-cinder-79001 Aug 25 01:29:26.521313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-332f8e4b-32c0-47b6-bfb8-4f9d766538f4 req-9e0263d5-8daf-4a24-9754-4aad87842c62 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Aug 25 01:29:26.522725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 197/380] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:29:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:29:26.637944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:26.651437 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-03baec4a-38b2-4b45-bfbf-3096edf3810d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.180362 Aug 25 01:29:26.652197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 184/381] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:26 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:27.081889 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:27.083250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:27.092878 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.093543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.094735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.095322 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.230876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:27.241151 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d770458a-9b56-4a9f-bd26-76904b9f394a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.163019 Aug 25 01:29:27.241731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 198/382] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:27 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:27.283484 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c9093ec-ab8f-4b8b-9801-eec314e584c1"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:27.284636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:27.303275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.303952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.304899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.305409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.614158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d2f23cdb-78fc-498a-b5d2-643ce888e6e6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335158 Aug 25 01:29:27.615401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 185/383] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:29:27 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:27.670633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:27.671381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:27.685160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.685878 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.686784 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.687217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.824964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:27.835585 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f7a7e4ff-7a57-451d-bb9c-1e489f936faa tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1502 microversion: 2.1 time: 0.169139 Aug 25 01:29:27.836319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 199/384] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:27 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:27.855873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3083382-ecbc-4d0e-9a6a-d5eb6eb5b613"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:27.857057 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:27.866381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.867089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.868056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.868754 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.896087 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] HTTP exception thrown: Cannot 'attach_volume' instance af8070a9-ffcd-46c1-b623-321a89e97512 while it is in vm_state rescued Aug 25 01:29:27.896918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Returning 409 to user: Cannot 'attach_volume' instance af8070a9-ffcd-46c1-b623-321a89e97512 while it is in vm_state rescued {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:29:27.897750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-48ce0fa3-ae65-4d95-afbf-a5c1887f6092 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046231 Aug 25 01:29:27.898290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 186/385] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:29:27 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 01:29:27.916990 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:27.917516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:27.923545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.924120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.924904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:27.925342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:27.994203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-15cd8adc-f2b1-4503-b2dc-1448133a713a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action" status: 202 len: 0 microversion: 2.1 time: 0.090361 Aug 25 01:29:27.997677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 200/386] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:27 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:29:28.003700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:28.004387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:28.011034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:28.011494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:28.012300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:28.012806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:28.141808 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:28.149975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7c764d54-7348-40ee-bb2b-7f6e6737e72c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1510 microversion: 2.1 time: 0.151072 Aug 25 01:29:28.150524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 187/387] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:27 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:28.258630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:28.259543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:28.266200 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:28.266951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:28.267909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:28.268550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:28.397637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:28.405451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-428ce4c0-cc52-40b5-82cb-71430fb9f47c tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.150945 Aug 25 01:29:28.415977 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 201/388] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:28 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:29.168658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:29.170105 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:29.177806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:29.178345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:29.179428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:29.179918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:29.313106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:29.321121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c7d53910-b281-4c4f-84de-d5630bf7fb6a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1510 microversion: 2.1 time: 0.156781 Aug 25 01:29:29.321755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 188/389] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:29 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:29.423748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:29.424362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:29.431355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:29.431801 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:29.433042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:29.433477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:29.556992 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:29.565247 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1b01024f-5978-4405-8c2f-2a247b9ad280 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.145737 Aug 25 01:29:29.565805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 202/390] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:29 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:30.338061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:30.339421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:30.345626 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:30.346128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:30.346904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:30.347338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:30.482584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:30.491927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-94aaf69f-1f3d-4df4-a751-f75ec4987f9e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1510 microversion: 2.1 time: 0.157486 Aug 25 01:29:30.492754 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 189/391] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:30 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:30.581506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:30.582080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:30.587817 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:30.588260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:30.589215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:30.589841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:30.721230 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:30.731755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e300e8f2-0cd8-48ca-8883-0f9728310aca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.153899 Aug 25 01:29:30.743275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 203/392] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:30 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:31.513732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:31.514578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:31.522439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:31.522926 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:31.523712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:31.524139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:31.657717 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:31.666061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-23692b46-c0ab-4b89-8d27-f01952cd32ac tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1516 microversion: 2.1 time: 0.156745 Aug 25 01:29:31.666751 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 190/393] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:31 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:31.750448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:31.751755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:31.757841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:31.758296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:31.759100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:31.759790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:31.912147 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:31.926566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b096534f-2893-4cc2-b86c-3abe442e4121 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.179501 Aug 25 01:29:31.929067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 204/394] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:31 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:32.146746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-ecff3508-56ba-4d09-bfb6-4b5cce935079 req-305bab0b-7e8b-4977-bc00-8fc28a7b7853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c911cb28-8536-4837-949e-328e54ed38cb", "name": "network-vif-plugged", "status": "completed", "tag": "e6cd8690-974e-4a85-bd2c-284c308dc717"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:32.149258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:29:32.149258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:29:32.156814 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-ecff3508-56ba-4d09-bfb6-4b5cce935079 req-305bab0b-7e8b-4977-bc00-8fc28a7b7853 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:32.157570 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-ecff3508-56ba-4d09-bfb6-4b5cce935079 req-305bab0b-7e8b-4977-bc00-8fc28a7b7853 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:32.175417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-ecff3508-56ba-4d09-bfb6-4b5cce935079 req-305bab0b-7e8b-4977-bc00-8fc28a7b7853 service nova] Creating event network-vif-plugged:e6cd8690-974e-4a85-bd2c-284c308dc717 for instance c911cb28-8536-4837-949e-328e54ed38cb on hv-cinder-79001 Aug 25 01:29:32.183277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-ecff3508-56ba-4d09-bfb6-4b5cce935079 req-305bab0b-7e8b-4977-bc00-8fc28a7b7853 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041610 Aug 25 01:29:32.184539 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 191/395] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:32.976142 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:32.976726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:32.982895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:32.983417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:32.984484 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:32.984998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:33.123136 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:33.130387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-33080a09-854b-41f7-adcf-7ad665c39a34 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1317 microversion: 2.1 time: 0.159320 Aug 25 01:29:33.146791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 205/396] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:32 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:33.201242 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:33.201968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:33.215055 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:33.215508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:33.216287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:33.216725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:33.367154 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:33.374962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fbae9911-b90f-4b06-abe6-4d0d6fa4aee8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1516 microversion: 2.1 time: 0.177638 Aug 25 01:29:33.386349 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 192/397] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:33 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:33.392409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ad9cc50-b617-4b94-83de-89c1cf8513ad"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:33.393826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:33.400417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:33.400970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:33.401752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:33.402188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:33.655859 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-21209b6c-c9d9-420e-a6a6-ebe2a82299d7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267244 Aug 25 01:29:33.656851 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 206/398] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:29:33 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:29:34.148591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:34.149204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:34.155575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:34.156218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:34.157032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:34.157465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:34.294364 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:34.314340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0fc0c762-9453-4b02-bcee-162a0ad07dbe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1507 microversion: 2.1 time: 0.169361 Aug 25 01:29:34.319364 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 193/399] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:34 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:35.240477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-34b62588-60a5-47b6-8a84-944fb16bc44e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:35.246869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34b62588-60a5-47b6-8a84-944fb16bc44e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:35.247508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34b62588-60a5-47b6-8a84-944fb16bc44e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:35.321840 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-34b62588-60a5-47b6-8a84-944fb16bc44e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Going to try to stop instance {{(pid=108271) force_stop /opt/stack/nova/nova/compute/api.py:2614}} Aug 25 01:29:35.378426 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-34b62588-60a5-47b6-8a84-944fb16bc44e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 202 len: 0 microversion: 2.1 time: 0.143068 Aug 25 01:29:35.379973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 207/400] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:35 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:29:35.388230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:35.389191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:35.399323 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:35.400069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:35.401072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:35.410337 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:35.562492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:35.570742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b522de3e-b952-4466-b62e-5aa019c90798 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.186264 Aug 25 01:29:35.571331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 194/401] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:35 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:35.726261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf225b44-501a-44cc-9033-e000f434e943"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:35.727491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:35.733546 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:35.734191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:35.734989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:35.735432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:35.993186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6cc06424-9466-4f39-9904-166add383e1b tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "POST /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270901 Aug 25 01:29:35.994048 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 208/402] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:29:35 2021] POST /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:36.588351 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:36.588884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:36.594904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:36.595347 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:36.596275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:36.596710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:36.725828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:36.733464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-15250326-d2ba-4ca4-8238-ce0080535254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.148765 Aug 25 01:29:36.734014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 195/403] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:36 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:37.752521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:37.753238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:37.760129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:37.760584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:37.761387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:37.761823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:37.892288 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:37.901019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-439d7aa6-f2da-44c8-bf27-4e12d804eb2f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.153048 Aug 25 01:29:37.904932 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 209/404] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:37 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:38.917294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:38.917969 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:38.924095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:38.924545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:38.925303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:38.925909 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:39.227514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:39.235379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-66cadb11-ca81-4f93-b4e8-7298fa785c39 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.321798 Aug 25 01:29:39.245354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 196/405] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:38 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:40.255853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:40.257190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:40.264568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:40.265070 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:40.265938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:40.266361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:40.400355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:40.408952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-308ed1f0-b753-4450-91cc-9f98a651d4e3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.159084 Aug 25 01:29:40.409930 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 210/406] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:40 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:41.427537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:41.430102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:41.437821 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:41.438132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:41.439088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:41.439528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:41.566892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:41.575174 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-73e01d0e-34ee-452d-8267-dfa84e45c6ad tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.151523 Aug 25 01:29:41.575977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 197/407] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:41 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:42.280951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:42.282011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:42.290450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.290938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.291831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.292188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.315437 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lazy-loading 'flavor' on Instance uuid af8070a9-ffcd-46c1-b623-321a89e97512 {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:29:42.451755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d8e91436-491b-4e20-a4f2-92b9e9a07841 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action" status: 200 len: 32 microversion: 2.1 time: 0.174345 Aug 25 01:29:42.456652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 211/408] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:42 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:29:42.468514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:42.471203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:42.477831 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.478328 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.479170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.479816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.594612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:42.596275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:42.603482 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.604360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.605523 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:42.606225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:42.619117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:42.628444 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2a8134dd-12c9-4517-93e3-b190f51886ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.167742 Aug 25 01:29:42.629043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 198/409] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:42 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:42.774244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:42.783067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bc8c6fbb-cff9-47e2-965b-a34328697d3b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.193674 Aug 25 01:29:42.793381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 212/410] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:42 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:43.648359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:43.648888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:43.655465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:43.655917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:43.656724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:43.657192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:43.800166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:43.800960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:43.808244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:43.808962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:43.809963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:43.810394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:43.813600 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:43.827319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-40f3c802-81d9-4640-90cb-ea1d51af00dc tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.183127 Aug 25 01:29:43.828786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 199/411] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:43 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:43.955702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:43.964160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bb0ad40e-3839-43aa-8b28-02aa6b675a5e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.167692 Aug 25 01:29:43.964737 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 213/412] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:43 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:44.846229 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:44.846969 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:44.853886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:44.854576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:44.855503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:44.856108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:44.984295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:44.984897 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:44.993024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:44.993760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:44.994856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:44.995556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:45.001510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:45.010743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4be34b36-650d-44cd-b3c3-897740a01ae5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.168372 Aug 25 01:29:45.011302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 200/413] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:44 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:45.123553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:45.132773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-82c0b395-937f-439a-b33a-707ad376db4d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.153102 Aug 25 01:29:45.133676 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 214/414] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:44 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:46.028049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:46.028658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:46.034322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:46.034794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:46.035551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:46.035978 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:46.150284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:46.152209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:46.158618 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:46.159114 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:46.159894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:46.160330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:46.165496 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:46.174382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-49d54ecd-4594-423d-87d0-d1eccc80d748 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.149908 Aug 25 01:29:46.175092 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 201/415] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:46 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:46.279416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:46.287140 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d1285a6a-0e4d-47b2-bbe9-b021e1ce345c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.141828 Aug 25 01:29:46.287698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 215/416] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:46 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:47.191354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:47.191971 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:47.198312 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:47.198791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:47.199551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:47.199987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:47.304326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:47.305566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:47.311368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:47.311816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:47.313300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:47.313746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:47.314763 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:47.322977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-254eb735-7371-43a8-845d-2d271e5c4032 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.135201 Aug 25 01:29:47.323532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 202/417] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:47 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:47.439379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:47.448135 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0e4e3f50-b1c8-4475-86d4-3270c1421254 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.147347 Aug 25 01:29:47.448635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 216/418] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:47 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:48.340944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:48.342196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:48.348682 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.349138 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:48.350106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.350751 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:48.464394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:48.465000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:48.470608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.471077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:48.471827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.472252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:48.480453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:48.495012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-40bb9b1c-a51b-4f60-95da-2a327ffea017 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.157971 Aug 25 01:29:48.505024 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 203/419] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:48 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:48.617772 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:48.625437 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-af98202b-961a-465f-bead-2f29b1926d29 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.164687 Aug 25 01:29:48.625997 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 217/420] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:48 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:48.972755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:48.973263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:48.978987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.979437 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:48.980196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:48.980629 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.071675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lazy-loading 'services' on Instance uuid c911cb28-8536-4837-949e-328e54ed38cb {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:29:49.158517 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-46d7903c-0ee3-40d6-a615-deeda245eeca tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments/bf225b44-501a-44cc-9033-e000f434e943" status: 202 len: 0 microversion: 2.1 time: 0.189425 Aug 25 01:29:49.162794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 204/421] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:29:48 2021] DELETE /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments/bf225b44-501a-44cc-9033-e000f434e943 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:29:49.169837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:49.172695 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:49.185061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.187027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.190634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.191661 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.247506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-75cd1bcd-b7bb-4d6c-b774-0c3c3e731eb0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083701 Aug 25 01:29:49.249796 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 218/422] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:49 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:29:49.512907 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:49.514480 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:49.520881 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.521396 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.522391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.522916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.641930 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:49.642508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:49.650454 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.651202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.651969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:49.652559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:49.669291 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:49.682814 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1483b1ba-0ab8-4a9f-9d49-15c771f4b451 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.173933 Aug 25 01:29:49.683555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 205/423] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:49 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:49.775985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:49.784042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ac1177d9-52a5-4476-b2e7-0db482c891b3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.145990 Aug 25 01:29:49.794111 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 219/424] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:49 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:50.260598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:50.261816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:50.268338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.268729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.269805 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.270240 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.300378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b6f63f95-0414-44da-bd94-2a67c66fa9cf tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Aug 25 01:29:50.301225 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 206/425] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:50 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:50.699649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:50.700207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:50.706988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.707468 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.708241 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.708954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.801218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:50.802491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:50.809429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.810000 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.810879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:50.811393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:50.844681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:50.855755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bc56f6de-c979-4ea5-a844-bc508675552d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.159317 Aug 25 01:29:50.856899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 220/426] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:50 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:50.975195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:50.994543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5528b0fd-ccc7-433c-b02e-7588476ad70f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.197006 Aug 25 01:29:50.995195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 207/427] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:50 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:51.325667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:51.327260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:51.335633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:51.336876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:51.338374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:51.339095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:51.381033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a987e8fd-54da-4cfa-96e8-1fcbcde88de7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071810 Aug 25 01:29:51.383515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 221/428] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:29:51 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:29:51.874060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:51.874060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:51.880807 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:51.881675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:51.882719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:51.883367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.011382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:52.017043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:52.018807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:52.020478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-911d4df8-5b89-4c67-abbf-8ea68d44d522 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.150970 Aug 25 01:29:52.021225 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 208/429] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:51 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:52.041325 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.041975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.042893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.043429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.174544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:52.188044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-28b88e80-5c72-41ab-a4ee-d531c5402668 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.179113 Aug 25 01:29:52.204583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 222/430] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:52 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:52.618982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:52.619803 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:52.626294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.627249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.628367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.629112 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.656868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:29:52.735947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9267b51a-e1e0-4883-84bb-d99223d304fe tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 204 len: 0 microversion: 2.1 time: 0.121113 Aug 25 01:29:52.737170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 209/431] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:29:52 2021] DELETE /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:29:52.745315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:52.746193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:52.753538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.754331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.755236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:52.756007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:52.907677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:52.916240 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bfbfe8c5-81d5-4449-9196-ceca067088f8 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1513 microversion: 2.1 time: 0.175020 Aug 25 01:29:52.922423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 223/432] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:52 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:53.042006 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:53.042748 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:53.048590 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.049044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:53.049806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.050478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:53.178775 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:53.187690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fbaf0d94-ab47-464a-86eb-80273c5fe331 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.150233 Aug 25 01:29:53.188261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 210/433] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:53 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:53.211970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:53.212577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:53.219153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.219822 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:53.220625 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.221055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:53.373096 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:53.383184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-147717d3-5c1a-4612-9279-55b2f1fd8d20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.175190 Aug 25 01:29:53.383957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 224/434] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:53 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:53.937056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:53.937678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:53.944460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.944917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:53.945692 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:53.946167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:54.102911 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:54.110668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6d0aa39b-106c-4cc7-9f40-355d8513bc87 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1513 microversion: 2.1 time: 0.177399 Aug 25 01:29:54.111272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 211/435] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:53 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:54.204683 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:54.205218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:54.211523 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:54.212352 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:54.213838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:54.214284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:54.345079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:54.357769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-209b45e1-a5da-4923-b26c-2c3caa66f0d5 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.156871 Aug 25 01:29:54.358535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 225/436] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:54 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:54.402171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:54.403051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:54.410256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:54.410746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:54.411903 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:54.412636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:54.557058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:54.565581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ca3be5fa-63e0-402f-8e82-8175944e6727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.168615 Aug 25 01:29:54.576023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 212/437] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:54 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:55.128573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:55.129184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:55.134910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.135353 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.136104 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.136531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.268983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:55.276411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-df7be50d-f9f1-488f-9e72-96cf25291617 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1513 microversion: 2.1 time: 0.152366 Aug 25 01:29:55.276975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 226/438] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:55 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:55.375376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:55.377224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:55.385008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.385556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.386410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.386980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.524117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:55.532355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-da714a26-1cdd-4e36-8856-509332ac4ddb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.160986 Aug 25 01:29:55.542617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 213/439] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:55 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:55.583082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:55.583806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:55.589819 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.590367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.591236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.591745 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.724754 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:55.733113 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-38bfa11c-b75f-4125-98b1-08d9ce02d077 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1723 microversion: 2.1 time: 0.153898 Aug 25 01:29:55.734142 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 227/440] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:55 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:55.768444 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-0237c50b-ef59-4f01-92e0-16837662e7ea req-7dbb2748-43eb-471e-92bf-26d9abdf295d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c911cb28-8536-4837-949e-328e54ed38cb", "name": "network-vif-deleted", "tag": "e6cd8690-974e-4a85-bd2c-284c308dc717"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:55.770055 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:29:55.770055 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:29:55.778177 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-0237c50b-ef59-4f01-92e0-16837662e7ea req-7dbb2748-43eb-471e-92bf-26d9abdf295d service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:55.778630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-0237c50b-ef59-4f01-92e0-16837662e7ea req-7dbb2748-43eb-471e-92bf-26d9abdf295d service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:55.790807 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-0237c50b-ef59-4f01-92e0-16837662e7ea req-7dbb2748-43eb-471e-92bf-26d9abdf295d service nova] Creating event network-vif-deleted:e6cd8690-974e-4a85-bd2c-284c308dc717 for instance c911cb28-8536-4837-949e-328e54ed38cb on hv-cinder-79001 Aug 25 01:29:55.795917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-0237c50b-ef59-4f01-92e0-16837662e7ea req-7dbb2748-43eb-471e-92bf-26d9abdf295d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Aug 25 01:29:55.796510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 214/441] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:29:56.293399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:56.294132 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:56.300119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.300561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.301321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.301875 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.332431 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.332882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.333361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lazy-loading 'fault' on Instance uuid c911cb28-8536-4837-949e-328e54ed38cb {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:29:56.390160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:56.397731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ed3588ad-9b19-42fc-8e08-f37087ca585a tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 200 len: 1307 microversion: 2.1 time: 0.108726 Aug 25 01:29:56.398874 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 228/442] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:56 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:56.550030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:56.550855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:56.557333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.557864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.558815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.559404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.684069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:56.691809 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6bfaab62-e207-468c-be56-a1dfa2daae1b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.146323 Aug 25 01:29:56.692376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 215/443] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:56 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:56.750564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:56.751410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:56.758017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.758550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.759463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.759914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.881141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:56.889570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0699c091-5a7f-47ef-86ba-7b9bb601c9ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1700 microversion: 2.1 time: 0.142648 Aug 25 01:29:56.890258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 229/444] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:56 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1700 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:56.906028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5e989d3c-3c58-40c9-bb85-ec79359d3371 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:56.911862 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e989d3c-3c58-40c9-bb85-ec79359d3371 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:56.912305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5e989d3c-3c58-40c9-bb85-ec79359d3371 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:56.971147 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5e989d3c-3c58-40c9-bb85-ec79359d3371 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Going to try to start instance {{(pid=108270) start /opt/stack/nova/nova/compute/api.py:2637}} Aug 25 01:29:57.011389 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5e989d3c-3c58-40c9-bb85-ec79359d3371 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 202 len: 0 microversion: 2.1 time: 0.108614 Aug 25 01:29:57.011963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 216/445] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:29:56 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:29:57.020383 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:57.021047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:57.027184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.027844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.028886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.029391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.161204 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:57.169911 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b4445d96-4032-410c-9b2b-cf66465ac80e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1709 microversion: 2.1 time: 0.153130 Aug 25 01:29:57.170471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 230/446] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:57 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:57.416295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:57.416992 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: c911cb28-8536-4837-949e-328e54ed38cb] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:57.423413 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.423889 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.424643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.425095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.439953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Instance c911cb28-8536-4837-949e-328e54ed38cb could not be found. Aug 25 01:29:57.440682 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 404 to user: Instance c911cb28-8536-4837-949e-328e54ed38cb could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:29:57.441618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e11bab7a-5269-47bb-ba48-21cf4d766c33 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 25 01:29:57.442423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 217/447] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:57 2021] GET /compute/v2.1/servers/c911cb28-8536-4837-949e-328e54ed38cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:29:57.631318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-792194491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-225380796", "security_groups": [{"name": "tempest-secgroup-smoke-2088532483"}], "networks": [{"uuid": "321eee0d-c6be-433c-adb7-c8e082895ea9"}], "block_device_mapping_v2": [{"uuid": "e9f9a1e0-dc18-41b8-9d2f-e0875ab9478b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:29:57.712292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:57.713255 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:57.722962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.726864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.728204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:57.728780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:57.846789 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] validate_networks() for [('321eee0d-c6be-433c-adb7-c8e082895ea9', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:29:58.032477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:58.054502 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1dde301a-b0b9-4395-a993-014a1da412eb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.346556 Aug 25 01:29:58.057375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 218/448] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:57 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:58.189834 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:58.191082 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:58.201587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.203618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.204588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.206968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.454222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:58.468541 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3cc0f742-201c-4521-9c8d-bb5b47381e24 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1709 microversion: 2.1 time: 0.284470 Aug 25 01:29:58.470151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 219/449] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:58 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1709 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:58.490292 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:29:58.490747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:29:58.491218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:29:58.491623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:29:58.492073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:29:58.500302 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.500746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.501562 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.501987 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.519477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:29:58.524004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Getting quotas for user 31c9651dc204465eb9038c903a08910f and project cdf67756f57948e9a1bcaae4578b8fb6. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:29:58.584953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:58.586091 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:58.592054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.593023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.594146 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.594586 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.596342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:29:58.598663 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9f9a1e0-dc18-41b8-9d2f-e0875ab9478b',volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:29:58.624029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:29:58.710140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3b0d646c-fcdc-45ce-8532-3eef6ecbf96e tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 204 len: 0 microversion: 2.1 time: 0.128435 Aug 25 01:29:58.711981 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 220/450] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:29:58 2021] DELETE /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:29:58.724777 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:58.725969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-92129d77-c6fc-4964-b888-f3a99bc77bb1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.099380 Aug 25 01:29:58.727404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:58.727581 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 231/451] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:29:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:29:58.735591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.736034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.736807 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:58.736954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8a541b65-c237-4912-b316-23155c29460a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:58.737286 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:58.737718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8a541b65-c237-4912-b316-23155c29460a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:58.795317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8a541b65-c237-4912-b316-23155c29460a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:58.806295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8a541b65-c237-4912-b316-23155c29460a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1087 microversion: 2.1 time: 0.073000 Aug 25 01:29:58.815659 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 232/452] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:58 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:29:58.897680 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:58.905330 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fc2c3706-a7ef-412b-8d76-8cf5388d2eb7 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1513 microversion: 2.1 time: 0.184554 Aug 25 01:29:58.906096 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 221/453] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:58 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:59.072496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:59.072999 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:59.079855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.080250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.081044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.081471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.229898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:59.240150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bf74555e-9132-4716-a92b-e691871a2e61 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.172513 Aug 25 01:29:59.246824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 233/454] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:59 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:59.487633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:59.488575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:59.495963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.496503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.497387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.497829 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.653048 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:59.661083 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f1fcb107-b149-4753-85bd-a1be1e31fb72 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1713 microversion: 2.1 time: 0.177225 Aug 25 01:29:59.661513 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 222/455] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:59 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1713 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:59.825135 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:59.825756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:59.832522 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.832760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.833927 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.834498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.905307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:29:59.914574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5b57ba46-b308-475d-bd3c-b22026d115b1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1193 microversion: 2.1 time: 0.094383 Aug 25 01:29:59.915356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 234/456] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:59 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:29:59.939124 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:29:59.939861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:29:59.947600 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.948313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:29:59.949484 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:29:59.950072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:00.074411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:00.081533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-23f6eda5-1c69-4e19-84ce-0bf4af6ae08d tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1513 microversion: 2.1 time: 0.146863 Aug 25 01:30:00.082081 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 223/457] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:29:59 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:00.258853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:00.259458 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:00.266252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:00.266717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:00.267486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:00.267912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:00.391007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:00.398868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-78ed750c-a4dd-42ee-b828-bf51bd0b048d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.144283 Aug 25 01:30:00.399439 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 235/458] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:00 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:00.936005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:00.936617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:00.942350 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:00.942957 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:00.943576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:00.944009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:01.001697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:01.009772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-453ffd28-5fdb-47b6-9e82-61faa445c842 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1203 microversion: 2.1 time: 0.077408 Aug 25 01:30:01.010316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 224/459] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:00 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1203 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:01.097650 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:01.098260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:01.104578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:01.105027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:01.105792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:01.106225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:01.230936 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:01.238861 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b9ea7b35-cac8-4895-9b63-14c3a2231475 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1513 microversion: 2.1 time: 0.144758 Aug 25 01:30:01.239475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:01 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1513 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:01.416049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:01.416772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:01.422647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:01.423133 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:01.423893 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:01.424332 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:01.551398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:01.567459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5f34262b-3f29-42ce-8563-2d30b8c52127 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.148437 Aug 25 01:30:01.567459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 225/461] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:01 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:02.027318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:02.027933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:02.033886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.034340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.035133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.035564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.094393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:02.101642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f3b6dea9-753f-471b-b1c2-0d7a070d0ce7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1203 microversion: 2.1 time: 0.078609 Aug 25 01:30:02.102193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 237/462] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:02 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1203 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:02.256128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:02.256736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:02.265423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.266088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.266902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.267344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.388789 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:02.396348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-eac4fdec-f5d1-47d7-8d71-06f757128bf1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1513 microversion: 2.1 time: 0.144069 Aug 25 01:30:02.397002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 226/463] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:02 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:02.577880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:02.578671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:02.585362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.586096 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.587088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:02.587681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:02.723856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:02.734263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9010638e-94f4-4155-b429-7cbf55740eab tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.160757 Aug 25 01:30:02.734869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 238/464] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:02 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:03.118284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:03.119265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:03.125257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.125708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.126474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.126937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.218632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1424948526", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:03.260824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:03.269237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f0e415f9-2d90-487b-97f4-b7174e3f191a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.155533 Aug 25 01:30:03.269642 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 227/465] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:03 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:03.273451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] validate_networks() for None {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:30:03.413278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:03.414449 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:03.420346 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.421110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.422126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.422809 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.635211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:03.643556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-886c6c38-e9e1-4e48-9fc3-8a9d1d46e1e1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1513 microversion: 2.1 time: 0.233968 Aug 25 01:30:03.652995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:30:03.652995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:30:03.652995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:30:03.652995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:30:03.652995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:30:03.654229 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 228/466] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:03 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:03.661756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.662512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.663961 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.664548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.686362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Getting quotas for project af7953fd9085478886e801134807fdaa. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:30:03.690226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Getting quotas for user 0a0482a3d16145ee99796f833a2e6ba9 and project af7953fd9085478886e801134807fdaa. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:30:03.702270 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:30:03.704583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:30:03.755953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:03.757121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:03.767289 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.767858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.769165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.769591 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.794068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e822f3e6-6caf-4bd4-adfe-d6b4b8946534 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576824 Aug 25 01:30:03.800429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 239/467] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:30:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 01:30:03.824333 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-6ff28630-324b-44f1-b1b1-46e84df0a7b3 req-fdc96b78-9087-43c4-b1f6-d4744809ea1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:03.830411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:03.830411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:30:03.839968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-6ff28630-324b-44f1-b1b1-46e84df0a7b3 req-fdc96b78-9087-43c4-b1f6-d4744809ea1f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:03.840468 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-6ff28630-324b-44f1-b1b1-46e84df0a7b3 req-fdc96b78-9087-43c4-b1f6-d4744809ea1f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:03.854117 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-6ff28630-324b-44f1-b1b1-46e84df0a7b3 req-fdc96b78-9087-43c4-b1f6-d4744809ea1f service nova] Creating event network-changed:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:30:03.859681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-6ff28630-324b-44f1-b1b1-46e84df0a7b3 req-fdc96b78-9087-43c4-b1f6-d4744809ea1f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044516 Aug 25 01:30:03.860692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 240/468] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:03.867518 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5b4754f8-2a6a-456f-9abd-37fb4a0a512a tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:03.868976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5b4754f8-2a6a-456f-9abd-37fb4a0a512a tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:04.212738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5b4754f8-2a6a-456f-9abd-37fb4a0a512a tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:04.223901 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5b4754f8-2a6a-456f-9abd-37fb4a0a512a tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1215 microversion: 2.1 time: 0.361647 Aug 25 01:30:04.225409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 241/469] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:03 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:04.278013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:04.287037 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:04.287692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:04.297757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:04.298607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:04.300461 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-888ee185-c770-4dca-8f6c-642e3fb79bd0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.551326 Aug 25 01:30:04.302382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 229/470] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:03 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:04.311528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:04.312441 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:04.443924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:04.453046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e36d73a6-3567-4777-9a9f-cb5dc89ab6e3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.170319 Aug 25 01:30:04.454181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 242/471] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:04 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:04.660990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:04.661594 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:04.669659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:04.670930 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:04.671625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:04.672061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:04.708972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:04.709421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:04.709876 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lazy-loading 'fault' on Instance uuid 16bcdc99-e6b5-4242-a77b-9908957fc7c9 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:30:04.761229 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:04.768528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-96f16c8f-0956-48b5-a849-a81b059d6bc1 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 200 len: 1308 microversion: 2.1 time: 0.111638 Aug 25 01:30:04.778374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 230/472] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:04 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:05.242037 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.242632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.249999 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.255345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.256397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.257950 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.317744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.318506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.327614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.328484 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.330146 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.331186 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.338045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:05.348181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-af21d55e-63c3-45f2-b0c7-ab287ed6fa38 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1273 microversion: 2.1 time: 0.109621 Aug 25 01:30:05.359729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 243/473] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:05 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:05.472097 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.473105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.482518 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.490130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.492308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.493010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.522474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:05.548082 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d7afa3ec-af3a-4a06-963f-a576cbfe45ff tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.234499 Aug 25 01:30:05.549090 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 231/474] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:05 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:05.695214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:05.702726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-28295f13-a5b4-4fab-8460-f62220928007 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.236178 Aug 25 01:30:05.703299 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 244/475] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:05 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:05.786123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.786756 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 16bcdc99-e6b5-4242-a77b-9908957fc7c9] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.793173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.793618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.794369 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.794825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.809068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Instance 16bcdc99-e6b5-4242-a77b-9908957fc7c9 could not be found. Aug 25 01:30:05.809651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 404 to user: Instance 16bcdc99-e6b5-4242-a77b-9908957fc7c9 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:05.810506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a76d6b6c-ecc7-4288-9f3f-7f718d095022 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9" status: 404 len: 111 microversion: 2.1 time: 0.028632 Aug 25 01:30:05.811057 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 232/476] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:05 2021] GET /compute/v2.1/servers/16bcdc99-e6b5-4242-a77b-9908957fc7c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:05.819109 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.819615 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.825578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.826081 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.826947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.827566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.854046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:30:05.880093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-028cca0e-c172-4f4d-9c2c-d77c255d998d req-ac2608fb-714e-437e-ba66-6646a58965ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16bcdc99-e6b5-4242-a77b-9908957fc7c9", "name": "network-vif-deleted", "tag": "e5f74a04-7e2e-4039-9b3d-fb3695831c47"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:05.881916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:05.881916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:05.889884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-028cca0e-c172-4f4d-9c2c-d77c255d998d req-ac2608fb-714e-437e-ba66-6646a58965ec service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.890512 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-028cca0e-c172-4f4d-9c2c-d77c255d998d req-ac2608fb-714e-437e-ba66-6646a58965ec service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.902767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-028cca0e-c172-4f4d-9c2c-d77c255d998d req-ac2608fb-714e-437e-ba66-6646a58965ec service nova] Creating event network-vif-deleted:e5f74a04-7e2e-4039-9b3d-fb3695831c47 for instance 16bcdc99-e6b5-4242-a77b-9908957fc7c9 on hv-cinder-79001 Aug 25 01:30:05.909266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-028cca0e-c172-4f4d-9c2c-d77c255d998d req-ac2608fb-714e-437e-ba66-6646a58965ec service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Aug 25 01:30:05.910627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 233/477] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:05.964463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8a5ca6bb-6bfa-4326-b4a8-8f43f06ff311 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 204 len: 0 microversion: 2.1 time: 0.145055 Aug 25 01:30:05.966757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 245/478] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:30:05 2021] DELETE /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 01:30:05.973320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:05.974005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:05.980527 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.981188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:05.981945 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:05.982382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.113387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:06.121966 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aa7bc1dc-f7d1-4df0-a268-12e8fcc15560 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1514 microversion: 2.1 time: 0.152385 Aug 25 01:30:06.122545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 234/479] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:05 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:06.365951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:06.368337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:06.374797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.375551 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.376818 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.377458 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.546887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:06.565967 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9ae3e0fb-b56e-4a8d-bff6-e74e96a54d15 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.202972 Aug 25 01:30:06.566483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:06.567253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:06.567923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 246/480] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:06 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:06.574208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.574656 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.575472 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.576046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.721356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:06.722044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:06.736858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.737618 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.738652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:06.739030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:06.740738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:06.748518 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d5f796b0-6a62-4512-b0ed-b13f2dbcbe2d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.186505 Aug 25 01:30:06.758744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 235/481] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:06 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:06.888429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:06.900764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e58ac9fc-a20a-460c-9816-c969354d7781 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.180169 Aug 25 01:30:06.900764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 247/482] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:06 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:07.139085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:07.139610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:07.149610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.150070 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.150984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.151421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.417670 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:07.427426 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9433af5f-c0bd-4dfc-aba4-4782126b5106 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1514 microversion: 2.1 time: 0.291989 Aug 25 01:30:07.439814 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 236/483] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:07 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:07.583551 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:07.584164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:07.590489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.590969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.591734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.592164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.722732 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:07.732594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6dda18fd-fb7c-4394-a5d6-5e75192f2db4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.151414 Aug 25 01:30:07.738933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 248/484] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:07 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:07.767570 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:07.768658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:07.775236 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.775906 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.776674 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.777099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.913525 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:07.915911 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:07.916767 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:07.923281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.923563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b8a0c203-8e85-46f0-b102-8275ff499a81 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.159464 Aug 25 01:30:07.924082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.933124 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 237/485] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:07 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:07.936120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.936750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.954563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-c7a797e8-2a2f-46ad-a67a-37476057226d req-2b7c6d65-9c0b-4c57-93e6-a923fa3fe1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2a31c8-9646-48cc-9923-4d0b2c86ac4e", "tag": "d2c9461c-457e-49bf-9c05-26bec93865bd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:07.957700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:07.957700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:07.980105 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c7a797e8-2a2f-46ad-a67a-37476057226d req-2b7c6d65-9c0b-4c57-93e6-a923fa3fe1e9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:07.980560 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c7a797e8-2a2f-46ad-a67a-37476057226d req-2b7c6d65-9c0b-4c57-93e6-a923fa3fe1e9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:07.996507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-c7a797e8-2a2f-46ad-a67a-37476057226d req-2b7c6d65-9c0b-4c57-93e6-a923fa3fe1e9 service nova] Creating event network-changed:d2c9461c-457e-49bf-9c05-26bec93865bd for instance 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e on hv-cinder-79001 Aug 25 01:30:08.001325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-c7a797e8-2a2f-46ad-a67a-37476057226d req-2b7c6d65-9c0b-4c57-93e6-a923fa3fe1e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073212 Aug 25 01:30:08.002279 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 238/486] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:30:08.126293 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:08.134873 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9567b526-e48e-43f5-8c8b-397ca53b191d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.222482 Aug 25 01:30:08.135553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 249/487] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:07 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:08.447794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:08.448507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:08.455073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.455455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.456258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.456762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.660367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:08.676599 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-63a1cebf-4573-4202-9a9c-849b7ce2fcbd tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 200 len: 1514 microversion: 2.1 time: 0.233153 Aug 25 01:30:08.687433 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 239/488] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:08 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:08.748893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:08.749503 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:08.757776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.759426 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.760396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.763683 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.941134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:08.941920 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:08.949110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.952353 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.953358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:08.962637 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:08.970671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:08.986924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6be5d601-b4bb-4c8f-8e0a-272054ad5d95 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.241491 Aug 25 01:30:08.992519 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 250/489] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:08 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:09.132927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:09.143088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-de83a7e5-1912-4d04-a7b5-d4351fc6803a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.205978 Aug 25 01:30:09.144417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 240/490] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:08 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:09.152906 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:09.153973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:09.166925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:09.167381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:09.168159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:09.168603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:09.353617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:09.364493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-88e29f1f-34b7-48c7-b9f1-099f55a6f365 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.215972 Aug 25 01:30:09.365402 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 251/491] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:09 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:09.693637 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:09.694174 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 0d778d2b-3b3c-47da-a582-8738028e63c4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:09.699880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:09.700319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:09.701073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:09.701500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:09.714820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Instance 0d778d2b-3b3c-47da-a582-8738028e63c4 could not be found. Aug 25 01:30:09.715399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 404 to user: Instance 0d778d2b-3b3c-47da-a582-8738028e63c4 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:09.716203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-682638dc-a69a-4d9e-b90c-c47fe0bd9ada tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4" status: 404 len: 111 microversion: 2.1 time: 0.026251 Aug 25 01:30:09.719859 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 241/492] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:09 2021] GET /compute/v2.1/servers/0d778d2b-3b3c-47da-a582-8738028e63c4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:10.008221 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:10.008842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:10.015324 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.015889 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.016723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.017086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.033980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-2e9cf423-ff05-4825-981e-5f89ca5605eb req-0023fc1d-6444-40be-bf2a-48b765de5267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d778d2b-3b3c-47da-a582-8738028e63c4", "name": "network-vif-deleted", "tag": "123d311e-58d1-4bc6-8a02-ba0daafdb4d1"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:10.035710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:10.035710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:10.043997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2e9cf423-ff05-4825-981e-5f89ca5605eb req-0023fc1d-6444-40be-bf2a-48b765de5267 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.049647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2e9cf423-ff05-4825-981e-5f89ca5605eb req-0023fc1d-6444-40be-bf2a-48b765de5267 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.060835 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-2e9cf423-ff05-4825-981e-5f89ca5605eb req-0023fc1d-6444-40be-bf2a-48b765de5267 service nova] Creating event network-vif-deleted:123d311e-58d1-4bc6-8a02-ba0daafdb4d1 for instance 0d778d2b-3b3c-47da-a582-8738028e63c4 on hv-cinder-79001 Aug 25 01:30:10.065831 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-2e9cf423-ff05-4825-981e-5f89ca5605eb req-0023fc1d-6444-40be-bf2a-48b765de5267 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036474 Aug 25 01:30:10.066488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 242/493] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:10.168661 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:10.168802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:10.169451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:10.175546 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.176324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.177333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.177790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0283a7f4-8c19-41a6-b03b-5c0e1cb0fc10 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.173306 Aug 25 01:30:10.178216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.178698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 252/494] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:10 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:10.315765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:10.323481 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-12720a11-ec60-410f-b32d-118846b3298f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.166834 Aug 25 01:30:10.324034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 243/495] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:10 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:10.381198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:10.381798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:10.387799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.388568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.389389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.389923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.515765 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:10.528549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7b5969f3-2861-4e00-ac65-fe2681845e96 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.151175 Aug 25 01:30:10.529482 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 253/496] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:10 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:10.553063 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2052669274", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "84cb8eb6-9564-4dff-aed6-09b90ec75ea3"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:10.604190 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] validate_networks() for [('84cb8eb6-9564-4dff-aed6-09b90ec75ea3', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:30:10.853362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:10.853869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:10.859834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.860410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.861238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.861948 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.892112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:30:10.966421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:30:10.967847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:30:10.969053 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:30:10.969661 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:30:10.970266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:30:10.981502 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8cdfbdde-0db2-41ae-878d-a2891451bad3 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 204 len: 0 microversion: 2.1 time: 0.131019 Aug 25 01:30:10.982339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.982575 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 254/497] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:30:10 2021] DELETE /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:30:10.985584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.985584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:10.985584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:10.992742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:10.993573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:10.999603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.000043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.000827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.001270 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.011007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Getting quotas for project 91561edb5be742c6b2dfc64b3ffb7be2. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:30:11.015927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Getting quotas for user 756311ff29b94ccdbb85e2e8ac259f2d and project 91561edb5be742c6b2dfc64b3ffb7be2. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:30:11.026718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:30:11.029164 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:30:11.078217 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d4d9697e-9183-49ea-b2e3-6c61e29a51d2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528861 Aug 25 01:30:11.079166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 244/498] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:30:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:30:11.088610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c841eb19-6570-4cbb-9424-2b3bc36a6e57 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:11.089300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c841eb19-6570-4cbb-9424-2b3bc36a6e57 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:11.143613 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:11.154498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bb7007bb-362e-451d-b0f7-f12efe7a9d71 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1513 microversion: 2.1 time: 0.166299 Aug 25 01:30:11.155284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 255/499] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:10 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:11.177378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c841eb19-6570-4cbb-9424-2b3bc36a6e57 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:11.184891 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c841eb19-6570-4cbb-9424-2b3bc36a6e57 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1219 microversion: 2.1 time: 0.099909 Aug 25 01:30:11.186708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 245/500] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:11 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:11.199326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:11.199942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:11.206250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.206734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.207719 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.208160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.341533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:11.349256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:11.356406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.357043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.357984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.358589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.365479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:11.373453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4b1332c7-4807-434f-8aa5-3d2bceda59ae tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.177735 Aug 25 01:30:11.374029 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 256/501] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:11 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:11.498588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:11.508986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c0f385d3-c8fd-4031-a5d5-928eb351a4ef tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.171922 Aug 25 01:30:11.509551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 246/502] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:11 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:11.545220 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:11.545834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:11.551980 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.552434 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.553232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:11.553662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:11.682703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:11.689942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ac80f218-5dbb-41f8-a764-b1490c2701d4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.148447 Aug 25 01:30:11.690503 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 257/503] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:11 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:12.173119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:12.174416 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:12.185630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.186552 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.187602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.201746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:12.202979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:12.209000 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.216261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.216674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.218133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.218584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.345594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:12.358041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-81965222-aa1a-4eeb-b81d-cd7ea6f56d9d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1289 microversion: 2.1 time: 0.160127 Aug 25 01:30:12.359515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 258/504] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:12 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1289 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:12.391231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:12.392393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:12.399138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.399940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.400923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.401561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.474924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:12.483864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-dea37937-ac71-48ac-8047-676b5bd514d0 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1513 microversion: 2.1 time: 0.315048 Aug 25 01:30:12.488627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 247/505] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:12 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:12.525450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:12.526139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:12.533901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.535658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.537028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.538952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.662943 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:12.676531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3e514b59-27ec-4485-8635-181f59986921 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.288070 Aug 25 01:30:12.679828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 259/506] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:12 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:12.707737 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:12.708770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:12.718472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.719667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.720448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:12.722428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:12.791993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:12.804527 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-84f2a383-d9f7-4b1c-b181-6ea7ab28d18d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.282905 Aug 25 01:30:12.807862 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 248/507] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:12 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:12.958342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:12.968215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b36a5090-b7a0-4453-a62c-080d94b69121 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.264514 Aug 25 01:30:12.969020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 260/508] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:12 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:13.375493 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:13.376312 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:13.382472 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.383150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.384167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.384791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.504922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:13.505473 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:13.512870 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:13.515898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.516597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.517152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.517582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.523540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0aa0e957-7ca6-4573-b98c-b76537921fd1 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.151087 Aug 25 01:30:13.525048 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 249/509] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:13 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:13.691429 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f7490ad6cf4bed96cfec8a39a65b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46fe21ec575f40a0b26f9482a77b5a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:13.694555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:13.695208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:13.699888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3456fa5a-5d7e-4e8b-b484-39e60cf36492 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 200 len: 1513 microversion: 2.1 time: 0.198740 Aug 25 01:30:13.709126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 261/510] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:13 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:13.710471 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.711710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.711857 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.712307 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.762778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-26e272ab-5cfd-4f16-a9c9-cb2a0aafd13d req-3a312b4a-1b02-490d-9596-c69b0f5eaedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c445070-60d2-4f2d-8d55-b61613a6f11c", "name": "network-vif-deleted", "tag": "8e48c757-7e6e-4b84-9506-7c2d2575918f"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:13.764666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:13.764666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:30:13.771927 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-26e272ab-5cfd-4f16-a9c9-cb2a0aafd13d req-3a312b4a-1b02-490d-9596-c69b0f5eaedf service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.772876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-26e272ab-5cfd-4f16-a9c9-cb2a0aafd13d req-3a312b4a-1b02-490d-9596-c69b0f5eaedf service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.787161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-26e272ab-5cfd-4f16-a9c9-cb2a0aafd13d req-3a312b4a-1b02-490d-9596-c69b0f5eaedf service nova] Creating event network-vif-deleted:8e48c757-7e6e-4b84-9506-7c2d2575918f for instance 4c445070-60d2-4f2d-8d55-b61613a6f11c on hv-cinder-79001 Aug 25 01:30:13.792913 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-26e272ab-5cfd-4f16-a9c9-cb2a0aafd13d req-3a312b4a-1b02-490d-9596-c69b0f5eaedf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036984 Aug 25 01:30:13.793778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 262/511] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:30:13.824645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:13.826181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:13.833247 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.834989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.834989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:13.836552 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:13.861506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:13.869149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-71d90a5a-8901-452e-b205-6f2533062201 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.178180 Aug 25 01:30:13.870103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 250/512] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:13 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:13.971478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:13.979266 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8c58575c-e579-4a89-ad49-8570a76efd3a tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.158547 Aug 25 01:30:13.985533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:13.985698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 263/513] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:13 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:13.991282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:13.999690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.000318 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.001243 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.001824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.167823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:14.175795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-304969a8-a7a2-47ca-89d6-8ac7723bb3df tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.193764 Aug 25 01:30:14.183101 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 251/514] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:13 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:14.215785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-4b2fb8e7-a026-4ad4-967e-3b3a3acab00b req-8021c9f3-d92e-4916-97c5-1593d5ff640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2a31c8-9646-48cc-9923-4d0b2c86ac4e", "name": "network-vif-plugged", "status": "completed", "tag": "d2c9461c-457e-49bf-9c05-26bec93865bd"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:14.218065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:14.218065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:30:14.228201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-4b2fb8e7-a026-4ad4-967e-3b3a3acab00b req-8021c9f3-d92e-4916-97c5-1593d5ff640a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.228865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-4b2fb8e7-a026-4ad4-967e-3b3a3acab00b req-8021c9f3-d92e-4916-97c5-1593d5ff640a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.258728 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-4b2fb8e7-a026-4ad4-967e-3b3a3acab00b req-8021c9f3-d92e-4916-97c5-1593d5ff640a service nova] Creating event network-vif-plugged:d2c9461c-457e-49bf-9c05-26bec93865bd for instance 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e on hv-cinder-79001 Aug 25 01:30:14.264800 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-4b2fb8e7-a026-4ad4-967e-3b3a3acab00b req-8021c9f3-d92e-4916-97c5-1593d5ff640a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054495 Aug 25 01:30:14.265752 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 264/515] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:14.541293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:14.541905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:14.548562 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.549005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.549891 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.550368 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.702523 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:14.711383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-80a160c2-4579-45c5-982d-e2d677c8c0a2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.174333 Aug 25 01:30:14.712435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 252/516] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:14 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:14.718578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:14.719510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] [instance: 4c445070-60d2-4f2d-8d55-b61613a6f11c] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:14.725876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.726312 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.727103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.727530 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.740394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] HTTP exception thrown: Instance 4c445070-60d2-4f2d-8d55-b61613a6f11c could not be found. Aug 25 01:30:14.740968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] Returning 404 to user: Instance 4c445070-60d2-4f2d-8d55-b61613a6f11c could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:14.741798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-10736b70-8b2c-4c6a-a602-adbb46626a03 tempest-AttachVolumeNegativeTest-925107959 tempest-AttachVolumeNegativeTest-925107959-project] 10.222.0.23 "GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c" status: 404 len: 111 microversion: 2.1 time: 0.028442 Aug 25 01:30:14.742315 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 265/517] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:14 2021] GET /compute/v2.1/servers/4c445070-60d2-4f2d-8d55-b61613a6f11c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:30:14.885598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:14.886233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:14.892162 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.892615 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.893365 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:14.893790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:14.996248 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:14.997116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:15.004067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.004977 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.006399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.007829 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.058275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:15.067200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-cfccee3d-2395-41f5-9646-2d52e309f734 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1315 microversion: 2.1 time: 0.185500 Aug 25 01:30:15.077290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 253/518] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:14 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:15.176548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:15.184297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bb4b5995-b327-46a1-8031-db244a351c3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.191821 Aug 25 01:30:15.185042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 266/519] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:14 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:15.195478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:15.196101 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:15.201879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.202360 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.203168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.203723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.328072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:15.336980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1a373c51-6d6d-4c86-945c-8ebee4bbb9f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.144764 Aug 25 01:30:15.338309 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 254/520] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:15 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:15.728890 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:15.729497 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:15.735560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.736004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.736768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.737195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.808925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-a1f0ed50-27d6-4a6c-abbb-9b9c101a36bd req-002faf76-1755-429d-869f-ddd0523b3307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709", "tag": "e9e6a441-ed1f-4f7f-bf97-540f221b56d8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:15.810939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:15.810939 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:15.821189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a1f0ed50-27d6-4a6c-abbb-9b9c101a36bd req-002faf76-1755-429d-869f-ddd0523b3307 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:15.822308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a1f0ed50-27d6-4a6c-abbb-9b9c101a36bd req-002faf76-1755-429d-869f-ddd0523b3307 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:15.870854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-a1f0ed50-27d6-4a6c-abbb-9b9c101a36bd req-002faf76-1755-429d-869f-ddd0523b3307 service nova] Creating event network-changed:e9e6a441-ed1f-4f7f-bf97-540f221b56d8 for instance 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 on hv-cinder-79001 Aug 25 01:30:15.881130 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-a1f0ed50-27d6-4a6c-abbb-9b9c101a36bd req-002faf76-1755-429d-869f-ddd0523b3307 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075757 Aug 25 01:30:15.881765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 255/521] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:30:15.895865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:15.910612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4cb6589f-1aaa-4e67-9c72-97a9c5072852 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.185814 Aug 25 01:30:15.911814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 267/522] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:15 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:16.086040 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.086771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.100760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.101214 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.102021 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.102512 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.201266 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.202205 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.216642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.217435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.218638 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.219507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.270187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:16.282155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7342244e-64cc-44d1-8651-cc5f9b94b77b tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1464 microversion: 2.1 time: 0.201345 Aug 25 01:30:16.282703 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 256/523] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:16 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:16.342647 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.343156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.350975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.351967 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.352959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.353898 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.381388 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:30:16.457954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:16.466112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c443a383-7be4-4d10-a1b5-47dc2350a709 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.268774 Aug 25 01:30:16.473077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 268/524] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:16 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:16.479225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.480491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.503231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.503548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-477ee0e9-bc76-4a92-b45e-4dc1ad50b1e4 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 204 len: 0 microversion: 2.1 time: 0.164042 Aug 25 01:30:16.504966 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 257/525] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:30:16 2021] DELETE /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 01:30:16.507926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.510176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.510922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.516780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.517489 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.523613 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.524038 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.525005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.525567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.723662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:16.725753 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:16.731779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-70f3f7b6-715f-4dc8-948c-24e1fa5c05af tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.257270 Aug 25 01:30:16.732463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 269/526] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:16 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:16.734482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ce5b857d-2e31-458e-b5c0-a94f246bb25e tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1470 microversion: 2.1 time: 0.224863 Aug 25 01:30:16.735237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 258/527] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:16 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:16.928277 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:16.929002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:16.934933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.935388 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:16.936183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:16.936616 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.075036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:17.087535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2acbc5a3-6d9e-4ef1-ad5a-6402c2d5be53 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.162774 Aug 25 01:30:17.088114 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 270/528] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:16 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:17.490485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:17.491668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:17.497544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.497997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.498933 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.499373 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.630961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:17.639016 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-27ecb79b-689c-4959-8662-5e940bef3142 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.153420 Aug 25 01:30:17.639772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 259/529] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:17 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:17.749298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:17.750534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:17.753476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:17.754324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:17.757261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.758505 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.759447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.760009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.762401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.763035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.764581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:17.765170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:17.944020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:17.953720 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-896010b8-86d4-4da0-9c81-2cf98b001180 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.208553 Aug 25 01:30:17.956016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 271/530] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:17 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:17.983394 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:17.992195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-294e6974-4141-4319-b1e3-d46fb80d134c tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1470 microversion: 2.1 time: 0.243412 Aug 25 01:30:17.993114 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 260/531] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:17 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:18.107323 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:18.108015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:18.118181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.118642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.119451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.122026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.319718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:18.327934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9a21cef5-4406-4357-b549-ceca30f62239 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.226211 Aug 25 01:30:18.328830 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 272/532] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:18 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:18.640807 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-2ed7ff3f-b375-41a6-a56d-6dfe1d961768 req-ec57b0ae-fd6e-4352-a007-cbf9db76a6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2a31c8-9646-48cc-9923-4d0b2c86ac4e", "name": "network-vif-deleted", "tag": "d2c9461c-457e-49bf-9c05-26bec93865bd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:18.643224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:18.643224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:18.655041 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2ed7ff3f-b375-41a6-a56d-6dfe1d961768 req-ec57b0ae-fd6e-4352-a007-cbf9db76a6db service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.655872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2ed7ff3f-b375-41a6-a56d-6dfe1d961768 req-ec57b0ae-fd6e-4352-a007-cbf9db76a6db service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.657157 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:18.657821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:18.671005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.672119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-2ed7ff3f-b375-41a6-a56d-6dfe1d961768 req-ec57b0ae-fd6e-4352-a007-cbf9db76a6db service nova] Creating event network-vif-deleted:d2c9461c-457e-49bf-9c05-26bec93865bd for instance 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e on hv-cinder-79001 Aug 25 01:30:18.672265 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.674840 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.676036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.677235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-2ed7ff3f-b375-41a6-a56d-6dfe1d961768 req-ec57b0ae-fd6e-4352-a007-cbf9db76a6db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Aug 25 01:30:18.699716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 261/533] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:18.880665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:18.891098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a46042fe-75bd-4b5b-83e0-2a7eba1d1d27 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.238016 Aug 25 01:30:18.892197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 273/534] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:18 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:18.974031 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:18.975118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:18.982628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.983729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:18.985161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:18.986410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.010283 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:19.010879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:19.022010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.023030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.023820 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.024260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.076475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.077196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.077980 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lazy-loading 'fault' on Instance uuid 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:30:19.161088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a0482a3d16145ee99796f833a2e6ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af7953fd9085478886e801134807fdaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:19.170494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-adb2ac84-f70a-4cf1-93f4-4bd8b2fa5fd7 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 200 len: 1305 microversion: 2.1 time: 0.164360 Aug 25 01:30:19.182218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 274/535] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:19 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:19.199537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:19.207246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bdeff850-8033-4d0e-a418-16a8736df1b7 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.238147 Aug 25 01:30:19.208924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 262/536] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:18 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:19.345139 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:19.346868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:19.354895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.355353 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.356361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.356632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.515085 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:19.523637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f34ebd6c-b181-468d-81b7-1e511645158d tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.182226 Aug 25 01:30:19.524225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 275/537] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:19 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:19.908206 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:19.908825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:19.915222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.915675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:19.916566 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:19.916991 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.052199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:20.061145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-777c4787-59a6-4f04-bd49-57815baa5246 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.156773 Aug 25 01:30:20.061904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 263/538] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:19 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:20.187744 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:20.188960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] [instance: 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:20.204307 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-a5b99a47-175a-44f6-8b12-9d11e969bd78 req-7ff68e2d-27c0-4414-885f-e6cc345aaa5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709", "name": "network-vif-plugged", "status": "completed", "tag": "e9e6a441-ed1f-4f7f-bf97-540f221b56d8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:20.206224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:20.206224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:20.214512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.215521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.217727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.218150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.219677 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a5b99a47-175a-44f6-8b12-9d11e969bd78 req-7ff68e2d-27c0-4414-885f-e6cc345aaa5e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.220261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a5b99a47-175a-44f6-8b12-9d11e969bd78 req-7ff68e2d-27c0-4414-885f-e6cc345aaa5e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.244114 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-a5b99a47-175a-44f6-8b12-9d11e969bd78 req-7ff68e2d-27c0-4414-885f-e6cc345aaa5e service nova] Creating event network-vif-plugged:e9e6a441-ed1f-4f7f-bf97-540f221b56d8 for instance 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 on hv-cinder-79001 Aug 25 01:30:20.249050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] HTTP exception thrown: Instance 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e could not be found. Aug 25 01:30:20.249651 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] Returning 404 to user: Instance 3d2a31c8-9646-48cc-9923-4d0b2c86ac4e could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:20.250475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0ce9096a-87b6-4f72-ad5d-1716297bd6b0 tempest-VolumesNegativeTest-317264273 tempest-VolumesNegativeTest-317264273-project] 10.222.0.23 "GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e" status: 404 len: 111 microversion: 2.1 time: 0.066523 Aug 25 01:30:20.251063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 276/539] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:20 2021] GET /compute/v2.1/servers/3d2a31c8-9646-48cc-9923-4d0b2c86ac4e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:20.258249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-a5b99a47-175a-44f6-8b12-9d11e969bd78 req-7ff68e2d-27c0-4414-885f-e6cc345aaa5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053011 Aug 25 01:30:20.258249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 264/540] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:20.261554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:20.262161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:20.268756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.269213 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.270057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.270488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.495390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:20.506351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-af124095-8762-485e-bd3a-675783493302 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.251433 Aug 25 01:30:20.506351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 277/541] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:20 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:20.541297 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:20.541992 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:20.551143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.551585 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.552362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:20.552782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:20.776664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:20.787503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1b40d25a-a85b-4b39-bb2b-c2b2d8c7ead0 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.250642 Aug 25 01:30:20.788602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 265/542] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:20 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:21.082090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:21.082804 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:21.088958 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.089280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:21.090239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.090880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:21.230435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:21.238910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8a9871d8-c4de-43d7-be85-7981c621f329 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.163311 Aug 25 01:30:21.239234 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 278/543] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:21 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:21.522716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:21.523825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:21.529974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.530424 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:21.531244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.531668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:21.719884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:21.729653 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-85b4fcf3-fe0b-4236-be5e-06d5300aaa2b tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.210538 Aug 25 01:30:21.730901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 266/544] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:21 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:21.807465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:21.808289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:21.824179 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.824854 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:21.825856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:21.826482 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.062396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:22.073950 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-50f92f3b-6bbf-4de6-b108-784f6a54045b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1319 microversion: 2.1 time: 0.272902 Aug 25 01:30:22.075394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 279/545] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:21 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:22.261483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:22.262745 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:22.270581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:22.271309 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.272167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:22.272545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.305933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-569f3053-1dff-4a80-b4fc-8ce362cddc16 req-be571691-e4e6-4ec5-8b87-4d21f14c7ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "name": "network-vif-plugged", "status": "completed", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:22.308566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:22.308566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:30:22.316365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-569f3053-1dff-4a80-b4fc-8ce362cddc16 req-be571691-e4e6-4ec5-8b87-4d21f14c7ad6 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:22.316812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-569f3053-1dff-4a80-b4fc-8ce362cddc16 req-be571691-e4e6-4ec5-8b87-4d21f14c7ad6 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.328718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-569f3053-1dff-4a80-b4fc-8ce362cddc16 req-be571691-e4e6-4ec5-8b87-4d21f14c7ad6 service nova] Creating event network-vif-plugged:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:30:22.333900 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-569f3053-1dff-4a80-b4fc-8ce362cddc16 req-be571691-e4e6-4ec5-8b87-4d21f14c7ad6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Aug 25 01:30:22.334800 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 280/546] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:30:22.562095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:22.570652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ccfa0722-02e3-4135-a07a-ff7fbaf5c09c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.317763 Aug 25 01:30:22.571606 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 267/547] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:22 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:22.752432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:22.753610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:22.769587 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:22.770034 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.770896 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:22.771870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:22.970087 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:22.982286 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-df5515d9-71b7-4d29-8802-8bbe363e23bf tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1259 microversion: 2.1 time: 0.237173 Aug 25 01:30:22.984082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 281/548] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:22 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:23.094228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:23.094228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:23.099434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:23.100322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:23.101848 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:23.102743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:23.274053 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:23.285735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-38fb20cf-a842-4e5e-bb20-c7e3cab66f14 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1507 microversion: 2.1 time: 0.196227 Aug 25 01:30:23.285735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 268/549] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:23 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:23.588643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:23.589313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:23.597185 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:23.597632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:23.598379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:23.599130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:23.746509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:23.757278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a39e04a2-2a39-43c1-b956-e140783ded63 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.172592 Aug 25 01:30:23.758149 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 282/550] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:23 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:24.003644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:24.006008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:24.016695 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.017379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.018537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.019374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.205215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:24.214889 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-05c51d8e-870d-4eb5-9a3d-dca3e0e95e89 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1442 microversion: 2.1 time: 0.216743 Aug 25 01:30:24.215554 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 269/551] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:23 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1442 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:24.234475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:24.235297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:24.241773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.242219 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.243030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.243470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.366155 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:24.374922 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-86f3c72b-7b6f-4f87-a597-201450258929 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1442 microversion: 2.1 time: 0.145422 Aug 25 01:30:24.375501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 283/552] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:24 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1442 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:24.776826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:24.778230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:24.785614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.786314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.788533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:24.789288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:24.966722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:24.977780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b4c434b8-138d-475b-92bd-b9fa87df69a0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.205370 Aug 25 01:30:24.978369 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 270/553] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:24 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:25.995197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:25.996121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:26.008876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:26.009318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:26.010091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:26.010519 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:26.146828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:26.155225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fa840df8-9b97-436d-9d5a-26599a3072cb tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.163625 Aug 25 01:30:26.155780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 284/554] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:25 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:26.463386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-4249177f-6b89-42ea-8134-04efa6271d51 req-a0e50544-a768-49ad-97a0-bc849a731971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:26.465077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:26.465077 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:26.472218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4249177f-6b89-42ea-8134-04efa6271d51 req-a0e50544-a768-49ad-97a0-bc849a731971 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:26.472752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4249177f-6b89-42ea-8134-04efa6271d51 req-a0e50544-a768-49ad-97a0-bc849a731971 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:26.483546 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-4249177f-6b89-42ea-8134-04efa6271d51 req-a0e50544-a768-49ad-97a0-bc849a731971 service nova] Creating event network-changed:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:30:26.488660 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-4249177f-6b89-42ea-8134-04efa6271d51 req-a0e50544-a768-49ad-97a0-bc849a731971 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029138 Aug 25 01:30:26.489322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 271/555] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:27.172048 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:27.172802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:27.178961 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:27.179489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:27.180261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:27.180698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:27.302543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:27.311088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3f245007-35b1-4df8-bfda-e299836f8b3c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.142491 Aug 25 01:30:27.311660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 285/556] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:27 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:28.329179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:28.330020 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:28.336235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:28.336927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:28.338082 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:28.338727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:28.702009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:28.712340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ae1b1931-65cb-44b3-9ec2-7fb4f4df81b2 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.387283 Aug 25 01:30:28.713009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 272/557] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:28 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:29.729553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:29.730283 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:29.738046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:29.738768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:29.741242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:29.741708 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:29.886064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:29.895566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5d016fc9-3240-4bab-9234-5882daa808ee tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.168950 Aug 25 01:30:29.896576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 286/558] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:29 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:30.913620 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:30.914236 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:30.921305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:30.921828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:30.922618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:30.923201 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:31.060723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:31.070404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bb846911-bbe3-467b-b365-559eebfb9375 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.160665 Aug 25 01:30:31.071108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 273/559] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:30 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:32.088116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:32.088715 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:32.095394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:32.096043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:32.096890 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:32.097329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:32.237587 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:32.247098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a3aa218f-a0fd-415e-b030-382ee9c233ae tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.163187 Aug 25 01:30:32.247671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 287/560] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:32 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:33.268764 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:33.269365 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:33.278357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:33.279086 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:33.279859 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:33.280288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:33.407466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:33.417317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-40a8b97e-1ea8-4405-94e0-0a569e3c06e8 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.156212 Aug 25 01:30:33.430459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 274/561] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:33 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:34.434212 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:34.434905 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:34.442629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:34.443130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:34.444107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:34.444723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:34.593942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:34.603199 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3be6ca27-d104-4a26-93b1-a11e5e6a8422 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.172292 Aug 25 01:30:34.603998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 288/562] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:34 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:35.619733 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:35.621088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:35.627515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:35.628228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:35.629269 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:35.629929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:35.767444 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:35.775504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a0cb478c-bd14-499c-be88-6223aa5ed08f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1568 microversion: 2.1 time: 0.159650 Aug 25 01:30:35.776361 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 275/563] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:35 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:36.791235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:36.791768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:36.797665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:36.798195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:36.799080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:36.799516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:36.920680 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:36.928529 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-53e2781a-482f-45d7-bbdd-35a5017df75e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1548 microversion: 2.1 time: 0.140882 Aug 25 01:30:36.929094 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 289/564] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:36 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1548 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:36.945678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:36.946230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:36.951971 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:36.952415 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:36.953163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:36.953593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:37.036031 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] HTTP exception thrown: Cannot 'detach_volume' instance af8070a9-ffcd-46c1-b623-321a89e97512 while it is in vm_state rescued Aug 25 01:30:37.036712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Returning 409 to user: Cannot 'detach_volume' instance af8070a9-ffcd-46c1-b623-321a89e97512 while it is in vm_state rescued {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:37.037798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3ba7a7e2-4cec-4020-a601-e02254c88ec7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments/5ad9cc50-b617-4b94-83de-89c1cf8513ad" status: 409 len: 152 microversion: 2.1 time: 0.096420 Aug 25 01:30:37.038418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 276/565] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:30:36 2021] DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments/5ad9cc50-b617-4b94-83de-89c1cf8513ad => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 01:30:37.047112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:37.047602 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:37.053279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:37.053729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:37.054550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:37.055511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:37.123024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d54010b6-aaf5-4199-a793-871d7ff0aca3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action" status: 202 len: 0 microversion: 2.1 time: 0.079195 Aug 25 01:30:37.126970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 290/566] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:30:37 2021] POST /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:30:37.131732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:37.132520 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:37.139202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:37.139787 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:37.140619 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:37.141320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:37.311192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:37.333718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e4a10bf2-49cb-442b-a4bb-96e4c998ef83 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1556 microversion: 2.1 time: 0.205523 Aug 25 01:30:37.334975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 277/567] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:37 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:38.353105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:38.353742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:38.359876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:38.360332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:38.361115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:38.361543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:38.490167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:38.498747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cecc3ab0-0bdb-48ba-a433-47d95e5dd455 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1556 microversion: 2.1 time: 0.150070 Aug 25 01:30:38.499360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 291/568] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:38 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:39.517598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:39.518381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:39.524172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:39.524620 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:39.525382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:39.525826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:39.643878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:39.652017 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a71b16e0-1b99-4789-b93f-4b13c8341304 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1556 microversion: 2.1 time: 0.138406 Aug 25 01:30:39.652580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 278/569] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:39 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1556 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:40.668488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:40.669103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:40.675666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:40.676124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:40.676896 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:40.677342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:40.810263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:40.820422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0e5d6271-82ab-40c6-9edb-f9f26c01325b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1562 microversion: 2.1 time: 0.154684 Aug 25 01:30:40.821417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 292/570] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:40 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:40.907033 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:40.907527 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:40.913443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:40.913910 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:40.914665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:40.915114 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:40.996189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lazy-loading 'services' on Instance uuid af8070a9-ffcd-46c1-b623-321a89e97512 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:30:41.058027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fb7faedd-e61f-44a2-a62d-680d49c59a6e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments/5ad9cc50-b617-4b94-83de-89c1cf8513ad" status: 202 len: 0 microversion: 2.1 time: 0.154542 Aug 25 01:30:41.058642 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 279/571] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:30:40 2021] DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments/5ad9cc50-b617-4b94-83de-89c1cf8513ad => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:30:41.066823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:41.067750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:41.074083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:41.074534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:41.075330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:41.075779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:41.106044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-155223ec-7807-4d16-a2c8-31654801258c tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Aug 25 01:30:41.106599 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 293/572] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:30:41 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:42.117740 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:42.118866 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:42.125620 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:42.126067 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:42.126890 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:42.127325 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:42.155839 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c1118f81-bb56-40f4-acc4-3d80a5d3a9d0 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042240 Aug 25 01:30:42.156393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 280/573] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:30:42 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:30:44.475044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:44.475542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:44.482047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:44.482495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:44.483296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:44.483741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:44.507473 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:30:44.580481 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cdb7d558-39e3-4c43-9cdf-31016853617e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 204 len: 0 microversion: 2.1 time: 0.108732 Aug 25 01:30:44.581112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 294/574] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:30:44 2021] DELETE /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:30:44.589777 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:44.590456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:44.596528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:44.596977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:44.597734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:44.598169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:44.714459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:44.721798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ee22d7bf-4957-433c-90f9-ef1c5ae6711e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1509 microversion: 2.1 time: 0.136496 Aug 25 01:30:44.722358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 281/575] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:44 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1509 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:45.738919 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:45.739605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:45.745485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:45.745924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:45.746686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:45.747121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:45.866495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:45.873636 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-11974e43-b9f2-4e60-82e5-7710ed94c104 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1509 microversion: 2.1 time: 0.138744 Aug 25 01:30:45.874189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 295/576] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:45 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1509 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:46.163039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a9c210c-3117-454a-9d04-6b89cdf1f6f1", "device": "/dev/sdb"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:46.164627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:46.170399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:46.170880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:46.171634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:46.172060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:46.396549 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a256f333-bbe6-4022-bb69-a7fb3ba0efc2 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "POST /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237024 Aug 25 01:30:46.397160 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 282/577] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:30:46 2021] POST /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709/os-volume_attachments => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:46.889833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:46.890445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:46.896537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:46.896991 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:46.897748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:46.898181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:47.014362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:47.021560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d80a796c-389b-42c0-962f-caa3a183fea3 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1509 microversion: 2.1 time: 0.135650 Aug 25 01:30:47.022120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 296/578] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:46 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1509 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:47.968587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-517b9e4d-66fb-4882-9b86-57ad324ce0ac req-ab919218-0072-4dbd-a568-8531a1a0c758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bb6f59-2965-4a94-a72b-36fd964c7ad4", "name": "network-vif-deleted", "tag": "12da0e27-c7a9-42f4-82da-178ee98a8aed"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:47.970044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:47.970044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:47.978040 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-517b9e4d-66fb-4882-9b86-57ad324ce0ac req-ab919218-0072-4dbd-a568-8531a1a0c758 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:47.978474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-517b9e4d-66fb-4882-9b86-57ad324ce0ac req-ab919218-0072-4dbd-a568-8531a1a0c758 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:47.988745 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-517b9e4d-66fb-4882-9b86-57ad324ce0ac req-ab919218-0072-4dbd-a568-8531a1a0c758 service nova] Creating event network-vif-deleted:12da0e27-c7a9-42f4-82da-178ee98a8aed for instance c9bb6f59-2965-4a94-a72b-36fd964c7ad4 on hv-cinder-79001 Aug 25 01:30:47.994103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-517b9e4d-66fb-4882-9b86-57ad324ce0ac req-ab919218-0072-4dbd-a568-8531a1a0c758 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029792 Aug 25 01:30:47.994788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 283/579] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:30:48.038062 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:48.038671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:48.044634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:48.045125 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:48.045955 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:48.046395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:48.076826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:48.077278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:48.077729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lazy-loading 'fault' on Instance uuid c9bb6f59-2965-4a94-a72b-36fd964c7ad4 {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:30:48.116510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:48.123678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8c54abcd-fb73-4063-b068-f65b25513f4e tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 200 len: 1312 microversion: 2.1 time: 0.089278 Aug 25 01:30:48.124251 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 297/580] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:48 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:49.141284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:49.141905 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: c9bb6f59-2965-4a94-a72b-36fd964c7ad4] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:49.147919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.148362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.149771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.150364 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.163713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] HTTP exception thrown: Instance c9bb6f59-2965-4a94-a72b-36fd964c7ad4 could not be found. Aug 25 01:30:49.164285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Returning 404 to user: Instance c9bb6f59-2965-4a94-a72b-36fd964c7ad4 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:30:49.165177 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5dd89f14-f79d-4c50-a14b-4bb513ac349b tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4" status: 404 len: 111 microversion: 2.1 time: 0.028424 Aug 25 01:30:49.165688 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 284/581] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:49 2021] GET /compute/v2.1/servers/c9bb6f59-2965-4a94-a72b-36fd964c7ad4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:30:49.173287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:49.173783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:49.179780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.180233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.181000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.181433 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.205528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:30:49.276933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6311b3fe-be99-4580-b51a-8e3ac1dc0703 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 204 len: 0 microversion: 2.1 time: 0.107006 Aug 25 01:30:49.277693 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 298/582] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:30:49 2021] DELETE /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:30:49.286566 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:49.287305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:49.293066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.293532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.294281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:49.294824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:49.410953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:49.417990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b243e79c-d656-461e-ab2f-9bfecfa1cac7 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.136032 Aug 25 01:30:49.418537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 285/583] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:49 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:50.435692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:50.436385 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:50.442134 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:50.442582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:50.443362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:50.443789 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:50.565727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:50.572826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b7c396ab-8b98-40a9-a78d-eb1653ad19e6 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.141573 Aug 25 01:30:50.573376 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 299/584] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:50 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:51.583156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:51.583668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:51.589265 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:51.589881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:51.590936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:51.591396 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:51.592193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:51.592628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:51.595801 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:51.596261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:51.597031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:51.597470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:51.682178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lazy-loading 'services' on Instance uuid 2383f568-887e-4b89-99c4-4dcda46666d0 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:30:51.718022 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:51.725461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-15abf8b8-5614-44e2-ad16-0be00734e083 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.139946 Aug 25 01:30:51.726204 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 300/585] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:51 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:51.756443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b49cf412-3823-4b30-8268-cef0ab0e02a3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments/0c9093ec-ab8f-4b8b-9801-eec314e584c1" status: 202 len: 0 microversion: 2.1 time: 0.176854 Aug 25 01:30:51.757015 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 286/586] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:30:51 2021] DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments/0c9093ec-ab8f-4b8b-9801-eec314e584c1 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:30:52.742802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:52.743422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:52.749384 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:52.749836 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:52.750629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:52.751055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:52.880596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:52.890959 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-dcbf8cbc-856c-42ae-8509-090a1be1d05d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.151580 Aug 25 01:30:52.898710 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 301/587] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:52 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:53.909429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:53.910126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:53.918039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:53.918508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:53.919318 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:53.920129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:53.974952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b88c6cdf-75a6-41ec-a712-823f8783d1c9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:53.981406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88c6cdf-75a6-41ec-a712-823f8783d1c9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:53.982063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88c6cdf-75a6-41ec-a712-823f8783d1c9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:54.006309 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b88c6cdf-75a6-41ec-a712-823f8783d1c9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Going to try to stop instance {{(pid=108271) force_stop /opt/stack/nova/nova/compute/api.py:2614}} Aug 25 01:30:54.060864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:54.062348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b88c6cdf-75a6-41ec-a712-823f8783d1c9 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 202 len: 0 microversion: 2.1 time: 0.091701 Aug 25 01:30:54.063017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 302/588] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:30:53 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:30:54.072530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c389192a-9ee4-4fb5-b15e-3a395fd57e3d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.166997 Aug 25 01:30:54.072694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:54.073263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 287/589] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:53 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:54.073392 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:54.080592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:54.081123 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:54.082260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:54.083360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:54.202758 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:54.210001 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-410a4798-12aa-47ca-8959-37bdbefb3700 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.142412 Aug 25 01:30:54.210567 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 303/590] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:54 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:55.088848 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:55.089450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:55.095238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:55.095681 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:55.096435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:55.096865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:55.212803 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:55.220204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ec67cd4c-ec1d-474e-a60d-baed7fc7a6b9 tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.134999 Aug 25 01:30:55.220758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 288/591] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:55 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:55.227082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:55.227689 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:55.233855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:55.234301 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:55.235077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:55.235501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:55.354803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:55.361946 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-98d6b39e-c7a5-4b1c-85c2-e2e5c035ff25 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.138399 Aug 25 01:30:55.362511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 304/592] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:55 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:56.236418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:56.237025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:56.243163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:56.244103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:56.244858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:56.245290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:56.360540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:56.367732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-de4bc730-3770-4eaa-8a68-72cf69d5a83d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.134948 Aug 25 01:30:56.368284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 289/593] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:56 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:56.378614 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:56.379251 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:56.385758 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:56.386209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:56.387062 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:56.387523 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:56.504779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:56.512150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8428c125-234f-44c8-89c6-22985bb05056 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.137151 Aug 25 01:30:56.512974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 305/594] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:56 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:57.385763 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:57.386395 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:57.392450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:57.392904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:57.393669 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:57.394107 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:57.516571 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:57.523896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2a7bf6d5-ea02-4e00-8f30-17b05fb8ee2f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1522 microversion: 2.1 time: 0.142514 Aug 25 01:30:57.524546 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 290/595] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:57 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:57.530240 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:57.531245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:57.537300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:57.537761 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:57.538530 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:57.539000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:57.658488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:57.666099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-5ece7715-c331-4de8-8d5e-5f8d76dee2d4 req-26f80e6a-d124-4607-a722-9877254be692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8070a9-ffcd-46c1-b623-321a89e97512", "name": "network-vif-deleted", "tag": "49373d89-72a8-4af4-8ddd-bb1be8f8d960"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:30:57.666569 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e453f755-94d3-48dd-9e25-a4acff6f710c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.140524 Aug 25 01:30:57.667234 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 306/596] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:57 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:30:57.668059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:30:57.668059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:30:57.675838 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-5ece7715-c331-4de8-8d5e-5f8d76dee2d4 req-26f80e6a-d124-4607-a722-9877254be692 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:57.676410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-5ece7715-c331-4de8-8d5e-5f8d76dee2d4 req-26f80e6a-d124-4607-a722-9877254be692 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:57.688755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-5ece7715-c331-4de8-8d5e-5f8d76dee2d4 req-26f80e6a-d124-4607-a722-9877254be692 service nova] Creating event network-vif-deleted:49373d89-72a8-4af4-8ddd-bb1be8f8d960 for instance af8070a9-ffcd-46c1-b623-321a89e97512 on hv-cinder-79001 Aug 25 01:30:57.693543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-5ece7715-c331-4de8-8d5e-5f8d76dee2d4 req-26f80e6a-d124-4607-a722-9877254be692 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 Aug 25 01:30:57.694108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 291/597] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:30:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:30:58.541128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:58.541775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:58.548354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:58.548745 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:58.549494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:58.549917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:58.608073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:58.615232 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4c73baec-3592-4f5d-9f01-4ec3378d60ad tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1306 microversion: 2.1 time: 0.078027 Aug 25 01:30:58.615783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 307/598] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:58 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1306 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:58.683410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:58.684116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:58.690093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:58.690545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:58.691350 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:58.691823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:58.811765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:58.818883 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6ae144ec-a426-42d0-9b30-a47087753875 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.139456 Aug 25 01:30:58.819438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 292/599] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:58 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:59.632116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:59.632656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:59.639319 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:59.639764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:59.640515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:59.640941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:59.698130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3376227e8648fb9d2e46875db4b998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9332813e5ed544a58621b5d1c5e0bbba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:59.705847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fc63e45f-cb06-4a4b-a1cd-e3e3afb07f4d tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 200 len: 1306 microversion: 2.1 time: 0.077397 Aug 25 01:30:59.706436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 308/600] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:59 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 1306 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:30:59.835483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:30:59.836100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:30:59.841903 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:59.842346 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:59.843136 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:30:59.843563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:30:59.958991 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:30:59.965982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a85f474e-9dcd-4534-95b4-b92900a10367 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.134158 Aug 25 01:30:59.966536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 293/601] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:30:59 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:00.721406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:00.722005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] [instance: af8070a9-ffcd-46c1-b623-321a89e97512] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:00.727717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:00.728157 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:00.728909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:00.729336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:00.742066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] HTTP exception thrown: Instance af8070a9-ffcd-46c1-b623-321a89e97512 could not be found. Aug 25 01:31:00.742634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] Returning 404 to user: Instance af8070a9-ffcd-46c1-b623-321a89e97512 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:31:00.743449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9d72b5f9-f62d-4105-b9ca-94194226b14f tempest-ServerRescueNegativeTestJSON-1443310748 tempest-ServerRescueNegativeTestJSON-1443310748-project] 10.222.0.23 "GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512" status: 404 len: 111 microversion: 2.1 time: 0.025680 Aug 25 01:31:00.743945 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 309/602] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:00 2021] GET /compute/v2.1/servers/af8070a9-ffcd-46c1-b623-321a89e97512 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:31:00.983116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:00.983746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:00.989640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:00.990112 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:00.990917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:00.991356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:01.108242 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:01.115609 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fc1010c1-7757-4df1-b4d3-1dbe7f842bb1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.136152 Aug 25 01:31:01.116165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 294/603] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:00 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:02.132754 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:02.133362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:02.139866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:02.140314 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:02.141095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:02.141512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:02.265696 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:02.273008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-40dec722-708e-461b-8e6e-f3e71f05f23f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.143893 Aug 25 01:31:02.274101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 310/604] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:02 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:03.290602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:03.291266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:03.296963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:03.297408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:03.298162 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:03.298750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:03.434298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:03.441794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ed6f7e34-2c23-4974-b2b4-119279f10db5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.154846 Aug 25 01:31:03.442363 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 295/605] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:03 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:04.459773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:04.460391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:04.469633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:04.470057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:04.470864 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:04.471304 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:04.598490 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:04.605910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-084bd14e-f2f9-4747-886a-cfb26a17f45f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.150394 Aug 25 01:31:04.606465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 311/606] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:04 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:05.622253 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:05.622972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:05.630346 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:05.630921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:05.631794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:05.632426 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:05.869604 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:05.882371 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4ff13fc3-5a70-4e6c-b09a-3acb314bc483 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.263865 Aug 25 01:31:05.883519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 296/607] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:05 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:06.900596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:06.901209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:06.908879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:06.909651 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:06.910984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:06.911736 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:06.944576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:06.945170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:06.953995 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:06.954722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:06.958251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:06.958949 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:07.066958 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lazy-loading 'services' on Instance uuid 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:31:07.137267 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-47f61ea7-6c58-4287-84bb-0cd2a6c8660f tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709/os-volume_attachments/3a9c210c-3117-454a-9d04-6b89cdf1f6f1" status: 202 len: 0 microversion: 2.1 time: 0.196586 Aug 25 01:31:07.138714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 297/608] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:31:06 2021] DELETE /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709/os-volume_attachments/3a9c210c-3117-454a-9d04-6b89cdf1f6f1 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:07.373834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:07.381492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-126ec33b-de3a-4ea8-a4f9-33a42f27c569 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.485500 Aug 25 01:31:07.382058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 312/609] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:06 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:08.286568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:08.288824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:08.295650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.296174 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.297010 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.297612 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.324727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:31:08.407401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:08.409971 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:08.413366 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8f8cfa05-d126-496b-917f-f9955d314dc4 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 204 len: 0 microversion: 2.1 time: 0.132876 Aug 25 01:31:08.414157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 298/610] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:31:08 2021] DELETE /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:31:08.420268 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.420721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.421720 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.422240 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.428771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:08.429929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:08.441401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.441938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.443359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:08.444417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:08.696475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:08.703220 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:08.709499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0f735c7d-91b8-4cf7-974f-266230006cfa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1677 microversion: 2.1 time: 0.314430 Aug 25 01:31:08.710353 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 313/611] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:08 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1677 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:08.710802 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d35894a4-6abb-4129-acac-5a5b0bde6593 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1513 microversion: 2.1 time: 0.291264 Aug 25 01:31:08.711504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 299/612] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:08 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:09.248078 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: .version_select at 0x7fd58dd56d30>, body: {"keypair": {"name": "tempest-keypair-210552620"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:09.266119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:31:09.270091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:31:09.526827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:31:09.531357 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:31:09.544218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9dc59c5f-7091-4475-8051-18a1729d4083 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.439095 Aug 25 01:31:09.545177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 314/613] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Aug 25 01:31:09 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 25 01:31:09.728673 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:09.729357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:09.729971 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:09.730567 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:09.736559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:09.737169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:09.737792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:09.738103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:09.738433 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:09.738573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:09.739525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:09.740073 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:09.942524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:09.951439 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d3d2d21a-7328-4406-a499-5d56c97db98c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1513 microversion: 2.1 time: 0.227183 Aug 25 01:31:09.952072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 315/614] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:09 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:09.968950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:09.977686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1ff569d0-baa5-4d60-97bf-b73ee0ced7df tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1654 microversion: 2.1 time: 0.253602 Aug 25 01:31:09.988577 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 300/615] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:09 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1654 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:09.993780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8cb6c65a-3e15-4889-958f-b5bc9856597c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:10.000156 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cb6c65a-3e15-4889-958f-b5bc9856597c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:10.000611 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8cb6c65a-3e15-4889-958f-b5bc9856597c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:10.023561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8cb6c65a-3e15-4889-958f-b5bc9856597c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Going to try to start instance {{(pid=108271) start /opt/stack/nova/nova/compute/api.py:2637}} Aug 25 01:31:10.063731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8cb6c65a-3e15-4889-958f-b5bc9856597c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action" status: 202 len: 0 microversion: 2.1 time: 0.073452 Aug 25 01:31:10.064408 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 316/616] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:31:09 2021] POST /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:10.073043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:10.073651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:10.080038 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:10.080535 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:10.081410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:10.081887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:10.209896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:10.217292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a4799803-610d-45ac-84e8-a31f0828e97a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1663 microversion: 2.1 time: 0.148045 Aug 25 01:31:10.217858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 301/617] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:10 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:10.975326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:10.976817 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:10.985280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:10.986066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:10.987160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:10.988826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:11.148735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:11.157672 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-791a3036-d729-4d1f-8cf2-84c689523b64 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 200 len: 1513 microversion: 2.1 time: 0.192204 Aug 25 01:31:11.158985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 317/618] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:10 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:11.233856 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:11.234455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:11.240726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:11.241089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:11.242043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:11.242473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:11.270772 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-6d4061e5-0808-4600-a1a7-c6954028f186 req-a34e0204-a3b0-448d-aaf4-c76a64a18d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709", "name": "network-vif-deleted", "tag": "e9e6a441-ed1f-4f7f-bf97-540f221b56d8"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:11.272779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:11.272779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:31:11.284218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-6d4061e5-0808-4600-a1a7-c6954028f186 req-a34e0204-a3b0-448d-aaf4-c76a64a18d30 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:11.284653 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-6d4061e5-0808-4600-a1a7-c6954028f186 req-a34e0204-a3b0-448d-aaf4-c76a64a18d30 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:11.307557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-6d4061e5-0808-4600-a1a7-c6954028f186 req-a34e0204-a3b0-448d-aaf4-c76a64a18d30 service nova] Creating event network-vif-deleted:e9e6a441-ed1f-4f7f-bf97-540f221b56d8 for instance 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 on hv-cinder-79001 Aug 25 01:31:11.314540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-6d4061e5-0808-4600-a1a7-c6954028f186 req-a34e0204-a3b0-448d-aaf4-c76a64a18d30 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047368 Aug 25 01:31:11.315775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 318/619] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:31:11.446544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:11.454117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e59a472c-2c15-4815-ad48-ce8d3d69e7ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1663 microversion: 2.1 time: 0.224420 Aug 25 01:31:11.464285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 302/620] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:11 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1663 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:11.918989 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-582611802", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b39bbca-d99b-4c6f-89e1-463d16db2dba"}], "security_groups": [{"name": "tempest-securitygroup--1901130006"}], "key_name": "tempest-keypair-210552620", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:12.019787 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] validate_networks() for [('4b39bbca-d99b-4c6f-89e1-463d16db2dba', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:31:12.174501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:12.175298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:12.181222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.181800 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.182700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.183283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.198402 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] HTTP exception thrown: Instance 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 could not be found. Aug 25 01:31:12.199162 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Returning 404 to user: Instance 9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:31:12.200690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d7520f7d-59fb-49e8-9110-dd1791351df9 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709" status: 404 len: 111 microversion: 2.1 time: 0.029903 Aug 25 01:31:12.201658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 303/621] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:12 2021] GET /compute/v2.1/servers/9b0f17f2-a4b6-4d58-a830-bf0d5d7e8709 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:31:12.408750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:31:12.409175 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:31:12.409651 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:31:12.410063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:31:12.410476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:31:12.419861 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.420497 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.421478 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.421921 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.438935 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:31:12.443398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:31:12.459245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:31:12.461711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:31:12.470531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:12.471221 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:12.476983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.477667 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.478611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:12.479071 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:12.547072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7f2afbdb-966e-44e0-b5b5-87a2d94c25f3 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632585 Aug 25 01:31:12.553276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 319/622] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Aug 25 01:31:11 2021] POST /compute/v2.1/servers => generated 402 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 01:31:12.557189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:12.557800 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:12.630573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:12.641629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:12.642638 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:12.643774 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-73e13ded-8ddc-48d0-9e88-42408e997410 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1280 microversion: 2.20 time: 0.090243 Aug 25 01:31:12.644742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 320/623] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:12 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:12.690228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:12.697980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-20346012-6a06-4375-a74f-216f3cd1a3b0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1667 microversion: 2.1 time: 0.231048 Aug 25 01:31:12.698626 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 304/624] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:12 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1667 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:31:13.661536 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:13.662143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:13.670205 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:13.670652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:13.671470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:13.671899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:13.728634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:13.737411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:13.738999 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:13.740188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-330acc4c-d2cb-42f2-a8ff-568923560b95 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1284 microversion: 2.20 time: 0.082377 Aug 25 01:31:13.740738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 321/625] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:13 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1284 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:14.757133 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:14.757741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:14.764593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:14.765048 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:14.765816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:14.766252 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:14.826629 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:14.834523 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:14.836110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:14.837272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d42f4f1b-3d8d-4d3c-80ae-f315b47022fe tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1276 microversion: 2.20 time: 0.084010 Aug 25 01:31:14.837821 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 305/626] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:14 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:15.855195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:15.855883 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:15.862100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:15.862556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:15.863355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:15.863920 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:15.925931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:15.934472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:15.936052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:15.937171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e5d8c32f-a1ff-4457-ab6e-24b285febf07 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1338 microversion: 2.20 time: 0.085770 Aug 25 01:31:15.937727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 322/627] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:15 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:16.898793 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-1bbc68d2-b105-4e43-a73f-dc0f9a6d3f32 req-4c278b3c-7255-4e22-afeb-8fa2f1def22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:16.902659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:16.902659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:31:16.914952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-1bbc68d2-b105-4e43-a73f-dc0f9a6d3f32 req-4c278b3c-7255-4e22-afeb-8fa2f1def22a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:16.915630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-1bbc68d2-b105-4e43-a73f-dc0f9a6d3f32 req-4c278b3c-7255-4e22-afeb-8fa2f1def22a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:16.939847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-1bbc68d2-b105-4e43-a73f-dc0f9a6d3f32 req-4c278b3c-7255-4e22-afeb-8fa2f1def22a service nova] Creating event network-changed:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:31:16.946285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-1bbc68d2-b105-4e43-a73f-dc0f9a6d3f32 req-4c278b3c-7255-4e22-afeb-8fa2f1def22a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050591 Aug 25 01:31:16.946948 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 306/628] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:31:16.955908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:16.956538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:16.962585 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:16.963275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:16.964044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:16.964631 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:17.119549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:17.128767 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:17.130335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:17.131542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-341e5b11-1f36-4c64-b441-acbd5fdf5ae4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.179405 Aug 25 01:31:17.132167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 323/629] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:16 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:18.149772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:18.150462 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:18.157177 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:18.157618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:18.158371 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:18.158823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:18.277293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:18.285014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:18.286498 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:18.287635 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1dc35a4f-54f3-44b4-b1c8-7c23ac41f757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.141846 Aug 25 01:31:18.288189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 307/630] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:18 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:19.304326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:19.304909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:19.310806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:19.311258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:19.312021 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:19.312453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:19.433679 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:19.441316 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:19.442863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:19.443951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4ce56647-e4d4-46f6-ab57-c57daf4c9b4b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.143337 Aug 25 01:31:19.444517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 324/631] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:19 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:20.197157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-254959449", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "networks": [{"uuid": "84cb8eb6-9564-4dff-aed6-09b90ec75ea3"}]}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:20.246714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] validate_networks() for [('84cb8eb6-9564-4dff-aed6-09b90ec75ea3', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:31:20.464183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:20.465871 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:20.472148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:20.472794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:20.473572 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:20.474380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:20.649536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:31:20.650984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:31:20.651484 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:31:20.652853 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:31:20.653335 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:31:20.667446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:20.673179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:20.673628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:20.674423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:20.674883 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:20.676901 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:20.678546 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:20.679704 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-edd37cff-29c7-43b3-b6cc-d1477338b40c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.221526 Aug 25 01:31:20.680258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 325/632] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:20 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:20.691479 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Getting quotas for project 91561edb5be742c6b2dfc64b3ffb7be2. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:31:20.695306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Getting quotas for user 756311ff29b94ccdbb85e2e8ac259f2d and project 91561edb5be742c6b2dfc64b3ffb7be2. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:31:20.708143 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:31:20.710731 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:31:20.754917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1282978d-a0d3-42e5-a041-f9566fdd50ff tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561357 Aug 25 01:31:20.755549 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 308/633] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:31:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:31:20.765912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-04ed88f3-13a5-4605-998a-e9be43187d1e tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:20.766780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-04ed88f3-13a5-4605-998a-e9be43187d1e tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:20.816816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-04ed88f3-13a5-4605-998a-e9be43187d1e tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:20.823427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-04ed88f3-13a5-4605-998a-e9be43187d1e tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1218 microversion: 2.1 time: 0.062026 Aug 25 01:31:20.824533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 326/634] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:20 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:21.697625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:21.698241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:21.704213 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:21.704662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:21.705642 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:21.706568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:21.827900 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:21.835780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:21.837273 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:21.838344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e491d9ed-a6c9-401e-b582-381f81d408ea tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.144952 Aug 25 01:31:21.841396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:21.842016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:21.848820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 309/635] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:21 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:21.849186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:21.849674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:21.850584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:21.851080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:21.918761 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:21.926067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e08113f1-1373-4580-b25d-d35b120295cb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1276 microversion: 2.1 time: 0.089075 Aug 25 01:31:21.926621 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 327/636] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:21 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:22.588872 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-a4694da4-6c47-46f9-a159-669f19370f50 req-ab1607a1-1912-45a4-baaa-cd855389052f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "name": "network-vif-plugged", "status": "completed", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:22.591532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:22.591532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:31:22.598467 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a4694da4-6c47-46f9-a159-669f19370f50 req-ab1607a1-1912-45a4-baaa-cd855389052f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.599047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a4694da4-6c47-46f9-a159-669f19370f50 req-ab1607a1-1912-45a4-baaa-cd855389052f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:22.610281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-a4694da4-6c47-46f9-a159-669f19370f50 req-ab1607a1-1912-45a4-baaa-cd855389052f service nova] Creating event network-vif-plugged:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:31:22.615342 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-a4694da4-6c47-46f9-a159-669f19370f50 req-ab1607a1-1912-45a4-baaa-cd855389052f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030178 Aug 25 01:31:22.615919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 310/637] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:22.856045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:22.856688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:22.862409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.862906 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:22.863679 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.864115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:22.909370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-37a96125-59a7-4610-aaaa-9c174842f80b req-82fdb6eb-7cc5-4ac3-93b3-1ab530668cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bee6e99-f2a6-4433-9530-b4090aed762a", "tag": "feec4286-5f47-439f-b840-1b36dfbdcc99"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:22.917886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:22.917886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:31:22.931654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-37a96125-59a7-4610-aaaa-9c174842f80b req-82fdb6eb-7cc5-4ac3-93b3-1ab530668cf7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.934000 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-37a96125-59a7-4610-aaaa-9c174842f80b req-82fdb6eb-7cc5-4ac3-93b3-1ab530668cf7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:22.947401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-37a96125-59a7-4610-aaaa-9c174842f80b req-82fdb6eb-7cc5-4ac3-93b3-1ab530668cf7 service nova] Creating event network-changed:feec4286-5f47-439f-b840-1b36dfbdcc99 for instance 9bee6e99-f2a6-4433-9530-b4090aed762a on hv-cinder-79001 Aug 25 01:31:22.953042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-37a96125-59a7-4610-aaaa-9c174842f80b req-82fdb6eb-7cc5-4ac3-93b3-1ab530668cf7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050249 Aug 25 01:31:22.953807 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 311/638] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:22.958879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:22.959563 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:22.965600 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.966043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:22.966919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:22.967356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:23.021770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:23.029647 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:23.031188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:23.032277 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ac4b0ed5-90cb-43f4-98c2-2076baf6f057 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.180108 Aug 25 01:31:23.032833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 328/639] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:22 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:23.096683 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:23.103780 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8299c74a-90a6-4538-a53b-00abc280237b tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1318 microversion: 2.1 time: 0.148696 Aug 25 01:31:23.104331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 312/640] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:22 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:24.049743 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:24.050277 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:24.056051 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:24.056504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:24.057266 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:24.057700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:24.121668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:24.122963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:24.130123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:24.130603 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:24.131489 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:24.131987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:24.202882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:24.211867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:24.215197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:24.216668 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-999100a8-c92e-4777-af9c-5fbde7a20e4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1406 microversion: 2.20 time: 0.170360 Aug 25 01:31:24.217235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 329/641] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:24 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:24.265159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:24.272199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-00a91a47-b26f-4c37-b28d-83706bb549da tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1318 microversion: 2.1 time: 0.155052 Aug 25 01:31:24.272749 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 313/642] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:24 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:31:25.234404 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:25.235056 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:25.240870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.241321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.242082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.242517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.289080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:25.289666 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:25.295819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.296259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.297009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.297434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.393070 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:25.400666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:25.402167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:25.403328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f97ad175-2852-482b-842c-4f03a47e1273 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1597 microversion: 2.20 time: 0.172733 Aug 25 01:31:25.403886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 330/643] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:31:25 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:31:25.420592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:25.421083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:25.426740 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.427306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.427942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:25.428373 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:25.443408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:25.450617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-08a48670-0f75-4790-bc4c-5e502eb0f308 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1318 microversion: 2.1 time: 0.165182 Aug 25 01:31:25.451207 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 314/644] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:25 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:31:25.506492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f6667cec-38b0-4f69-8be6-81b2ac540707 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089861 Aug 25 01:31:25.507112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 331/645] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Aug 25 01:31:25 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:31:26.467794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:26.468399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:26.474462 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.474953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.475725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.476169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.609578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-d3c5214d-6a20-46f2-8e44-6c01b245b8ae req-cfe5a444-514b-4065-8655-0ec84a66a567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bee6e99-f2a6-4433-9530-b4090aed762a", "name": "network-vif-plugged", "status": "completed", "tag": "feec4286-5f47-439f-b840-1b36dfbdcc99"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:26.611394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:26.611394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:31:26.618533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-d3c5214d-6a20-46f2-8e44-6c01b245b8ae req-cfe5a444-514b-4065-8655-0ec84a66a567 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.619515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-d3c5214d-6a20-46f2-8e44-6c01b245b8ae req-cfe5a444-514b-4065-8655-0ec84a66a567 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.631066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-d3c5214d-6a20-46f2-8e44-6c01b245b8ae req-cfe5a444-514b-4065-8655-0ec84a66a567 service nova] Creating event network-vif-plugged:feec4286-5f47-439f-b840-1b36dfbdcc99 for instance 9bee6e99-f2a6-4433-9530-b4090aed762a on hv-cinder-79001 Aug 25 01:31:26.641131 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-d3c5214d-6a20-46f2-8e44-6c01b245b8ae req-cfe5a444-514b-4065-8655-0ec84a66a567 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035850 Aug 25 01:31:26.641998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 332/646] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:26.686928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:26.695575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-882f0c7a-0b66-48d7-a1b9-aff41b4265ca tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1318 microversion: 2.1 time: 0.231942 Aug 25 01:31:26.696211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 315/647] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:26 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:26.850819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-4576b5ff-8c39-4e36-959c-6dc736fff1bc req-b6591f03-b208-4171-8e4b-f6021b58f2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:26.851827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:26.853491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:26.853491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:31:26.854652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:26.862145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4576b5ff-8c39-4e36-959c-6dc736fff1bc req-b6591f03-b208-4171-8e4b-f6021b58f2b7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.862589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4576b5ff-8c39-4e36-959c-6dc736fff1bc req-b6591f03-b208-4171-8e4b-f6021b58f2b7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.864553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.864999 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.865938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:26.866544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:26.874208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-4576b5ff-8c39-4e36-959c-6dc736fff1bc req-b6591f03-b208-4171-8e4b-f6021b58f2b7 service nova] Creating event network-changed:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:31:26.879185 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-4576b5ff-8c39-4e36-959c-6dc736fff1bc req-b6591f03-b208-4171-8e4b-f6021b58f2b7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035192 Aug 25 01:31:26.879864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 316/648] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:27.094225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1171f654-2643-4f28-9140-e62a0de0216c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.254133 Aug 25 01:31:27.097440 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 333/649] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:26 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:27.712498 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:27.713200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:27.719439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:27.719892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:27.720665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:27.721131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:27.841670 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:27.848853 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4f138bdc-7c22-4ce3-a17a-a72cf6511351 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1318 microversion: 2.1 time: 0.140337 Aug 25 01:31:27.849633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 317/650] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:27 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:28.105648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:28.106644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:28.113139 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:28.113594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:28.114361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:28.114823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:28.178570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-38008ba9-5dbe-431e-87ff-91df3bad0062 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.077100 Aug 25 01:31:28.179181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 334/651] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:28 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:28.865533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:28.866141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:28.871929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:28.872379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:28.873134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:28.873567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:28.996425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:29.003558 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-db4b47fa-6a29-4aa2-8610-0252e4b90ebb tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1506 microversion: 2.1 time: 0.141796 Aug 25 01:31:29.004112 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 318/652] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:28 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1506 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:29.020839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04edd61e-3c85-48d5-aae7-d31b3392fd5a", "device": "/dev/sdb"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:29.022465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:29.029472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:29.029924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:29.030698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:29.031343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:29.189735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:29.190636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:29.196313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:29.197066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:29.197823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:29.198254 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:29.264468 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-29dfe8b5-f256-4676-ae0f-3eb5d0bdc73c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "POST /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247592 Aug 25 01:31:29.265175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ded8355c-a54c-4ea0-9966-ede05d641afa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.078949 Aug 25 01:31:29.265361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 335/653] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:31:29 2021] POST /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:29.266050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 319/654] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:29 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:30.277199 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:30.278432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:30.287382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:30.287852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:30.288608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:30.289298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:30.353394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d8403a6f-393a-4af0-a64a-f18177197b19 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.080872 Aug 25 01:31:30.354066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 336/655] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:30 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:31.364811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:31.365796 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:31.372179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:31.372624 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:31.373377 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:31.373804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:31.437169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-17d28d52-7640-415d-964f-d189c08adaa5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.076220 Aug 25 01:31:31.437772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 320/656] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:31 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:32.447359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:32.448399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:32.454723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:32.455235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:32.455909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:32.456357 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:32.516525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-25910d69-fccc-4954-95bc-62018a50b3c4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.073227 Aug 25 01:31:32.517214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 337/657] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:32 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:33.527888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:33.528947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:33.535410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:33.536028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:33.536607 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:33.537040 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:33.594628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e58f2fd9-28cf-4797-8fd8-a30e78a38f89 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.070756 Aug 25 01:31:33.595411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 321/658] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:33 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:34.605877 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:34.606898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:34.613399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:34.613844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:34.614598 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:34.615054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:34.676747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-11f438cf-28b2-4bca-9cb6-600ed9cb1423 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.074827 Aug 25 01:31:34.677335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 338/659] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:34 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:35.687938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:35.688921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:35.695298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:35.695741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:35.696494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:35.696932 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:35.762638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-45f67469-61bd-418f-bb26-456909fb66ac tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.077791 Aug 25 01:31:35.763223 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 322/660] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:35 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:36.774777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:36.775717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:36.783075 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:36.783516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:36.784341 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:36.784812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:36.846137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-29961fa8-7430-4bf6-a5ed-10ff7fb7fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 14 microversion: 2.20 time: 0.076133 Aug 25 01:31:36.850161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 339/661] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:36 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:37.857897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:37.858831 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:37.865334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:37.865773 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:37.866528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:37.866996 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:39.621794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d38bb890-5ea5-4a01-b71c-033b4c1d8d00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 16563 microversion: 2.20 time: 1.767195 Aug 25 01:31:39.622795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 323/662] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:37 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 16563 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:40.633538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:40.634557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:40.642009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:40.642451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:40.643235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:40.643667 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:42.784632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-71d4957c-e7cd-48fa-86f9-4363b4bb2d15 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 21966 microversion: 2.20 time: 2.154995 Aug 25 01:31:42.785933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 340/663] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:40 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 21966 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:43.796564 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:43.797471 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:43.803812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:43.804268 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:43.805026 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:43.805461 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:43.887691 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c06acfce-97cb-429d-80d8-fd045d884fe4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 23221 microversion: 2.20 time: 0.094909 Aug 25 01:31:43.888356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 324/664] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:43 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 23221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:44.900064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:44.901080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:44.907561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:44.908008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:44.908765 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:44.909196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:44.985164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-dd771de2-c512-4c14-9fa9-2257cf0f20e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 24409 microversion: 2.20 time: 0.088975 Aug 25 01:31:44.986061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 341/665] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:44 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 24409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:45.997096 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:45.998569 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:46.004892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:46.005333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:46.006084 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:46.006543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:46.085088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-36cf9517-33c5-4413-8d78-1e37fd761b1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 25850 microversion: 2.20 time: 0.091920 Aug 25 01:31:46.085721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 325/666] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:45 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 25850 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:46.425981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:46.426560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:46.432912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:46.433356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:46.434112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:46.434542 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:46.558603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lazy-loading 'services' on Instance uuid 9bee6e99-f2a6-4433-9530-b4090aed762a {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:31:46.662728 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-27b13272-18eb-47b6-b9c4-f72f66025aa6 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a/os-volume_attachments/04edd61e-3c85-48d5-aae7-d31b3392fd5a" status: 202 len: 0 microversion: 2.1 time: 0.240573 Aug 25 01:31:46.663265 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 342/667] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:31:46 2021] DELETE /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a/os-volume_attachments/04edd61e-3c85-48d5-aae7-d31b3392fd5a => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:47.097598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:47.098508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:47.104837 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.105277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:47.106030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.106453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:47.189991 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-273ba65b-f11d-4dc3-93cb-9c33d18ebf9a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 26818 microversion: 2.20 time: 0.096363 Aug 25 01:31:47.190622 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 326/668] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:47 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 26818 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:47.777753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:47.778333 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:47.784354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.784799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:47.785564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.785993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:47.810316 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:31:47.883543 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-40dd9425-b616-431d-8b11-ca10e4d9d205 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 204 len: 0 microversion: 2.1 time: 0.109929 Aug 25 01:31:47.887079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 343/669] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:31:47 2021] DELETE /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:31:47.892836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:47.893537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:47.900103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.900556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:47.901324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:47.901759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:48.019398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:48.026575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-744d896b-8d1c-4ddc-b7a7-b2d683ba220c tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1512 microversion: 2.1 time: 0.137766 Aug 25 01:31:48.027324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 327/670] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:47 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:48.201731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:48.202748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:48.208447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:48.208895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:48.209648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:48.210079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:48.296534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3206c1f3-7ac5-43f5-b0c0-a94bc0324d61 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 27576 microversion: 2.20 time: 0.098664 Aug 25 01:31:48.297092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 344/671] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:48 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 27576 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:49.043716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:49.044244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:49.050482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:49.050961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:49.051724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:49.052156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:49.168332 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:49.175512 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3b6a68b2-498a-4802-b1c8-fa4a16426288 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1512 microversion: 2.1 time: 0.135528 Aug 25 01:31:49.176076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 328/672] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:49 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1512 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:49.308348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:49.309267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:49.316216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:49.316660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:49.317413 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:49.317841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:49.399456 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a364b486-4fbc-4563-9af8-94d45e0fef21 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 27856 microversion: 2.20 time: 0.095003 Aug 25 01:31:49.400070 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 345/673] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:49 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 27856 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:50.192721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:50.193333 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:50.199393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:50.199850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:50.200639 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:50.201099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:50.412848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:50.413855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:50.422463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:50.422954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:50.423742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:50.424174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:50.517278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-71f74d5c-8558-4712-9840-f0c94a6b12f5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28190 microversion: 2.20 time: 0.108952 Aug 25 01:31:50.518615 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 346/674] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:50 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28190 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:50.522356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '756311ff29b94ccdbb85e2e8ac259f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91561edb5be742c6b2dfc64b3ffb7be2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:50.530617 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-b5d337e9-4a17-413f-a00e-bc743135d0c8 req-c20b78c8-88d3-45f6-bd4e-6c2afdf5f172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bee6e99-f2a6-4433-9530-b4090aed762a", "name": "network-vif-deleted", "tag": "feec4286-5f47-439f-b840-1b36dfbdcc99"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:50.532393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:50.532393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:31:50.532714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-35151566-c026-4a05-abc9-7de4f96727b3 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 200 len: 1512 microversion: 2.1 time: 0.343045 Aug 25 01:31:50.533089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 329/675] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:50 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:50.539894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b5d337e9-4a17-413f-a00e-bc743135d0c8 req-c20b78c8-88d3-45f6-bd4e-6c2afdf5f172 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:50.540544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b5d337e9-4a17-413f-a00e-bc743135d0c8 req-c20b78c8-88d3-45f6-bd4e-6c2afdf5f172 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:50.551759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-b5d337e9-4a17-413f-a00e-bc743135d0c8 req-c20b78c8-88d3-45f6-bd4e-6c2afdf5f172 service nova] Creating event network-vif-deleted:feec4286-5f47-439f-b840-1b36dfbdcc99 for instance 9bee6e99-f2a6-4433-9530-b4090aed762a on hv-cinder-79001 Aug 25 01:31:50.556367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-b5d337e9-4a17-413f-a00e-bc743135d0c8 req-c20b78c8-88d3-45f6-bd4e-6c2afdf5f172 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037045 Aug 25 01:31:50.556976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 347/676] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:51.529510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:51.530458 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:51.536630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:51.537069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:51.537817 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:51.538242 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:51.550465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:51.551191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] [instance: 9bee6e99-f2a6-4433-9530-b4090aed762a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:51.557064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:51.557508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:51.558265 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:51.558757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:51.573144 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] HTTP exception thrown: Instance 9bee6e99-f2a6-4433-9530-b4090aed762a could not be found. Aug 25 01:31:51.573736 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] Returning 404 to user: Instance 9bee6e99-f2a6-4433-9530-b4090aed762a could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:31:51.574579 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-288e118b-25b8-4e9e-adf0-7a9640505750 tempest-VolumesSnapshotTestJSON-1576902749 tempest-VolumesSnapshotTestJSON-1576902749-project] 10.222.0.23 "GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a" status: 404 len: 111 microversion: 2.1 time: 0.028512 Aug 25 01:31:51.575164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 348/677] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:51 2021] GET /compute/v2.1/servers/9bee6e99-f2a6-4433-9530-b4090aed762a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:31:51.603847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2572e5bd-fd77-4089-b755-59977aaffbde tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28190 microversion: 2.20 time: 0.077896 Aug 25 01:31:51.608299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 330/678] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:51 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28190 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:52.615873 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:52.616771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:52.622524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:52.623008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:52.623763 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:52.624680 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:52.685888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-98059560-8fa6-4e83-af09-822a2b804046 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28190 microversion: 2.20 time: 0.073557 Aug 25 01:31:52.687027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 349/679] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:52 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28190 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:53.698348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:53.699369 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:53.706282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:53.706762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:53.707516 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:53.707947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.597124 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5139d513-3277-42bd-adf1-f70b75f25aa0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28480 microversion: 2.20 time: 1.902657 Aug 25 01:31:55.597779 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 331/680] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:53 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28480 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:55.770862 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:55.771764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:55.778270 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.778745 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.779515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.779947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.810121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ad5b3f31-9408-4548-8cb1-c459683b79ea tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044404 Aug 25 01:31:55.816328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 350/681] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:31:55 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:31:55.871837 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:55.872421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:55.879218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.879668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.880430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.880936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.906022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:31:55.977339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8b50bc0c-9438-4a00-aa13-001957b7521c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 204 len: 0 microversion: 2.1 time: 0.109248 Aug 25 01:31:55.977983 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 332/682] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:31:55 2021] DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:31:55.987053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:55.988222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:55.994141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.994594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:55.995393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:55.995831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:56.117249 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:56.124448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-70341081-7e10-4dd2-9278-63031a5a853c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1673 microversion: 2.1 time: 0.141078 Aug 25 01:31:56.125564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 351/683] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:55 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1673 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:56.609520 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:56.610447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:56.616044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:56.616488 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:56.617237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:56.617665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:56.712833 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-93f0bae4-b8d2-47e3-be72-5deec14dd457 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28646 microversion: 2.20 time: 0.107383 Aug 25 01:31:56.713463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 333/684] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:56 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:57.142238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:57.142882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:57.149128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:57.149571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:57.150329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:57.150790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:57.268855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:57.276101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-615f5da4-c6e8-4093-92c4-2938a6e9a2a2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1673 microversion: 2.1 time: 0.137618 Aug 25 01:31:57.276662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 352/685] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:57 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1673 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:57.725718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:57.726734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:57.733316 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:57.733770 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:57.734614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:57.735148 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:57.822260 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-83eb0a2d-e89f-46ce-a3a9-4c6643bbc06d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28648 microversion: 2.20 time: 0.100660 Aug 25 01:31:57.822961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 334/686] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:57 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28648 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:58.293181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:58.293792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:58.300148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:58.300593 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:58.301359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:58.301790 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:58.422660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:58.429802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f1e9eae7-bb10-4543-8bb4-7bfb1acca436 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1673 microversion: 2.1 time: 0.140338 Aug 25 01:31:58.430364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 353/687] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:58 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:58.846873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:58.848714 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:58.858315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:58.858965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:58.860653 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:58.861495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:58.935545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-94a0ac91-ade0-4a07-bf62-f85bb713a3df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28648 microversion: 2.20 time: 0.104428 Aug 25 01:31:58.936486 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 335/688] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:58 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28648 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:31:59.115826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-b5e0f772-5cb9-4fe2-97a5-461f33b56816 req-51d5ef06-72b9-48bc-bee2-784dc8ae5fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2383f568-887e-4b89-99c4-4dcda46666d0", "name": "network-vif-deleted", "tag": "41aa4863-f6b3-4d81-ba00-6960a2966fa7"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:59.118355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:31:59.118355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:31:59.127912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b5e0f772-5cb9-4fe2-97a5-461f33b56816 req-51d5ef06-72b9-48bc-bee2-784dc8ae5fc7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.128637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b5e0f772-5cb9-4fe2-97a5-461f33b56816 req-51d5ef06-72b9-48bc-bee2-784dc8ae5fc7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:59.142834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-b5e0f772-5cb9-4fe2-97a5-461f33b56816 req-51d5ef06-72b9-48bc-bee2-784dc8ae5fc7 service nova] Creating event network-vif-deleted:41aa4863-f6b3-4d81-ba00-6960a2966fa7 for instance 2383f568-887e-4b89-99c4-4dcda46666d0 on hv-cinder-79001 Aug 25 01:31:59.149176 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-b5e0f772-5cb9-4fe2-97a5-461f33b56816 req-51d5ef06-72b9-48bc-bee2-784dc8ae5fc7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041326 Aug 25 01:31:59.150228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 354/689] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:31:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:31:59.447997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:31:59.448700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:59.455947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.456397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:59.457168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.457597 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:59.492012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.492465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:59.492973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lazy-loading 'fault' on Instance uuid 2383f568-887e-4b89-99c4-4dcda46666d0 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:31:59.541633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:31:59.551822 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-850caca2-322d-4ef3-8eee-efc35818650b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 200 len: 1325 microversion: 2.1 time: 0.107956 Aug 25 01:31:59.553293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 336/690] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:31:59 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 1325 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:31:59.949613 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:31:59.950608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:31:59.957395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.957841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:31:59.958838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:31:59.959281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:00.023609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5db9b236-a6ec-4c42-ab61-5ad791f3fa88 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28648 microversion: 2.20 time: 0.079295 Aug 25 01:32:00.024506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 355/691] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:31:59 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28648 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:00.569002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:00.569609 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:00.575985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:00.576431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:00.577338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:00.578260 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:00.594732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. Aug 25 01:32:00.595342 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:32:00.596179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3c1df2ef-acbd-4cc2-b531-dfa1a1b11f20 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 404 len: 111 microversion: 2.1 time: 0.030899 Aug 25 01:32:00.596734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 337/692] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:00 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:32:00.605540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-17d422d9-eaab-4c28-aa9a-92a7d911263a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '.version_select at 0x7fd58dc46430>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:00.625757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-17d422d9-eaab-4c28-aa9a-92a7d911263a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-95550047" status: 202 len: 0 microversion: 2.1 time: 0.024155 Aug 25 01:32:00.626344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 356/693] 10.222.0.23 () {58 vars in 1215 bytes} [Wed Aug 25 01:32:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-95550047 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:01.035840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:01.036784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:01.042467 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:01.042964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:01.043726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:01.044163 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:01.264278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: .version_select at 0x7fd58dbbf670>, body: {"keypair": {"name": "tempest-keypair-104999948"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:01.282901 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:01.286792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:01.762513 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:01.766029 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:01.778644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b189e4bf-2e38-440e-b2ab-86611732f9c6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.518625 Aug 25 01:32:01.779258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 357/694] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Aug 25 01:32:01 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:02.809785 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e6be5031-06f6-4af8-b798-4dbdc6bf4757 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 28648 microversion: 2.20 time: 1.777541 Aug 25 01:32:02.810477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 338/695] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:01 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 28648 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:03.001370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-683724239", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd6ab0d2-8137-4fff-919c-e0812b557a4f"}], "security_groups": [{"name": "tempest-securitygroup--1989605367"}], "key_name": "tempest-keypair-104999948", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:03.090044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] validate_networks() for [('fd6ab0d2-8137-4fff-919c-e0812b557a4f', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:32:03.456474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:32:03.457215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:32:03.457978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:32:03.458568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:32:03.459335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:32:03.469821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:03.470267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:03.471121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:03.471553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:03.493025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for project b76ebd48c69044859010968bacfba90b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:03.498449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Getting quotas for user e85a2de1c4214589916a2ef12655c5b4 and project b76ebd48c69044859010968bacfba90b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:03.517354 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:32:03.520400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:32:03.565681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-88283197-6fa1-4866-955a-024024b7926a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568736 Aug 25 01:32:03.566455 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 358/696] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:32:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:32:03.577217 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ecd9a3e2-8eb2-4a8d-b92c-4ca9a7356ffc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:03.578533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ecd9a3e2-8eb2-4a8d-b92c-4ca9a7356ffc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:03.631374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ecd9a3e2-8eb2-4a8d-b92c-4ca9a7356ffc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:03.638144 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ecd9a3e2-8eb2-4a8d-b92c-4ca9a7356ffc tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1236 microversion: 2.1 time: 0.065583 Aug 25 01:32:03.647892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 339/697] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:03 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:03.821902 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:03.822831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:03.830442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:03.830939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:03.831717 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:03.832156 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:03.911498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5cdc1528-4528-43ac-918e-05e490c18760 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 29788 microversion: 2.20 time: 0.093700 Aug 25 01:32:03.912825 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 359/698] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:03 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 29788 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:04.656489 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:04.657215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:04.664719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:04.665159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:04.665965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:04.666418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:04.733249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:04.740773 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-75fe3879-0190-46f2-8e7a-74edf4797aa3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1294 microversion: 2.1 time: 0.088855 Aug 25 01:32:04.750713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 340/699] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:04 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:04.924331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:04.925364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:04.932026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:04.932578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:04.933443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:04.933977 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:05.013349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c6438b12-daf3-4bda-b87b-186b25d5470d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 31688 microversion: 2.20 time: 0.093402 Aug 25 01:32:05.014343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 360/700] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:04 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 31688 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:05.744310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-4c6426ea-2809-4d0a-b702-22122623d905 req-222d4525-a549-4bb8-95c5-46a07ccf825b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b31568-9ffd-49b4-a05e-f336ad399d88", "tag": "2b2e8cee-7b57-4858-8548-d09e9e90e699"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:05.746304 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:05.746304 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:05.759966 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:05.769504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:05.784425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4c6426ea-2809-4d0a-b702-22122623d905 req-222d4525-a549-4bb8-95c5-46a07ccf825b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:05.785550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-4c6426ea-2809-4d0a-b702-22122623d905 req-222d4525-a549-4bb8-95c5-46a07ccf825b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:05.797361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:05.797816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:05.798603 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:05.799072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:05.814432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-4c6426ea-2809-4d0a-b702-22122623d905 req-222d4525-a549-4bb8-95c5-46a07ccf825b service nova] Creating event network-changed:2b2e8cee-7b57-4858-8548-d09e9e90e699 for instance c8b31568-9ffd-49b4-a05e-f336ad399d88 on hv-cinder-79001 Aug 25 01:32:05.819844 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-4c6426ea-2809-4d0a-b702-22122623d905 req-222d4525-a549-4bb8-95c5-46a07ccf825b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081594 Aug 25 01:32:05.820690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 341/701] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:32:05.955123 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:05.962525 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d737522a-1a6e-4efd-97cd-a0c1ada635a0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.206932 Aug 25 01:32:05.963189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 361/702] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:05 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:06.025508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:06.027343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:06.035324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:06.035769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:06.036542 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:06.036972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:06.111446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-839fa1d5-fe78-48ca-80c3-97754b3cba8c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 33205 microversion: 2.20 time: 0.090323 Aug 25 01:32:06.112076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 342/703] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:06 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 33205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:06.979110 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:06.979726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:06.985707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:06.986153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:06.986966 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:06.987400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:07.128075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:07.129960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:07.137902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:07.138422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:07.139446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:07.140836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:07.171054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:07.179261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4f518a79-9506-4aec-a83f-98419e917f1a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.203565 Aug 25 01:32:07.179934 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 362/704] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:06 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:07.223123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-862be616-8439-4064-b250-6c43652e716c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 33937 microversion: 2.20 time: 0.102621 Aug 25 01:32:07.223813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 343/705] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:07 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 33937 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:08.196337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:08.196940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:08.203129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:08.203578 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:08.204342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:08.204781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:08.236805 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:08.238234 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:08.245374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:08.245819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:08.246595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:08.247046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:08.322027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f67feac8-fb11-444d-a307-ebbb9ae66502 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 35163 microversion: 2.20 time: 0.090541 Aug 25 01:32:08.323200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 344/706] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:08 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 35163 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:32:08.325925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:08.333807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-13d0cc7b-de8f-4eb8-899c-e3ef0ca8e0f0 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.141189 Aug 25 01:32:08.334349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 363/707] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:08 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:09.334752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:09.335757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:09.342192 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:09.342641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:09.345412 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:09.345855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:09.349444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:09.351007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:09.357861 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:09.358555 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:09.359367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:09.360508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:09.419980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6af1e9ef-7c2a-45fe-a7df-321f43f3df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 36442 microversion: 2.20 time: 0.089441 Aug 25 01:32:09.424069 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 345/708] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:09 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 36442 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:09.488818 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:09.496343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0ecde0cd-d0c9-48a4-8dba-44a3e9b175f3 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.150443 Aug 25 01:32:09.496995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 364/709] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:09 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:10.433699 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:10.433699 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:10.440222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:10.440671 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:10.441430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:10.441960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:10.513446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:10.514053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:10.514891 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f0e5effb-0ba0-479e-b50d-664cb699e7f6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 37821 microversion: 2.20 time: 0.087185 Aug 25 01:32:10.515535 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 346/710] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:10 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 37821 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:10.520121 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:10.520569 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:10.521323 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:10.521749 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:10.641162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:10.648261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bfdf09c5-01dd-40dd-8f9a-05cae9106a8b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.138851 Aug 25 01:32:10.648814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 365/711] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:10 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:11.024044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-30a90c18-0203-4d2a-9ead-4e7ddfe50f91 req-5ef75e93-7e3b-4b0d-930a-c89b51036c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b31568-9ffd-49b4-a05e-f336ad399d88", "name": "network-vif-plugged", "status": "completed", "tag": "2b2e8cee-7b57-4858-8548-d09e9e90e699"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:11.025507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:11.025507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:11.033500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-30a90c18-0203-4d2a-9ead-4e7ddfe50f91 req-5ef75e93-7e3b-4b0d-930a-c89b51036c01 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:11.033950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-30a90c18-0203-4d2a-9ead-4e7ddfe50f91 req-5ef75e93-7e3b-4b0d-930a-c89b51036c01 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:11.045366 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-30a90c18-0203-4d2a-9ead-4e7ddfe50f91 req-5ef75e93-7e3b-4b0d-930a-c89b51036c01 service nova] Creating event network-vif-plugged:2b2e8cee-7b57-4858-8548-d09e9e90e699 for instance c8b31568-9ffd-49b4-a05e-f336ad399d88 on hv-cinder-79001 Aug 25 01:32:11.049953 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-30a90c18-0203-4d2a-9ead-4e7ddfe50f91 req-5ef75e93-7e3b-4b0d-930a-c89b51036c01 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029871 Aug 25 01:32:11.050536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 347/712] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:32:11.525708 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:11.526481 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:11.532267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:11.532712 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:11.533471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:11.533925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:11.619809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-68ccf47b-7bf6-4ad4-a169-f2c095877e2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 38197 microversion: 2.20 time: 0.097701 Aug 25 01:32:11.620437 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 366/713] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:11 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 38197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:11.665641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:11.666432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:11.672790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:11.673248 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:11.674009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:11.674443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:11.843180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:11.851195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-04741dd0-fd89-4b96-98d9-7e17e685ddd5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1362 microversion: 2.1 time: 0.189605 Aug 25 01:32:11.851930 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 348/714] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:11 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:12.631839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:12.632826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:12.639471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:12.639919 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:12.641189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:12.641627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:12.700528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-690655cf-1b81-4cba-86ca-8f5da9cae7e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 38197 microversion: 2.20 time: 0.072488 Aug 25 01:32:12.705173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 367/715] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:12 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 38197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:12.868290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:12.868993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:12.875834 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:12.876367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:12.877205 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:12.877718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:12.996277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:13.004007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3f016275-2743-4c04-ba83-53e613d05535 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1549 microversion: 2.1 time: 0.139334 Aug 25 01:32:13.004588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 349/716] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:12 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1549 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:13.021061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:13.021635 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:13.027917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:13.028364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:13.029122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:13.029549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:13.111519 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3226515b-c197-4553-b3e2-8e5612db6d07 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094403 Aug 25 01:32:13.113115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 368/717] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Aug 25 01:32:13 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:32:13.713884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:13.715131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:13.725696 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:13.726145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:13.727790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:13.729276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:13.796434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-05abc15f-a172-4052-8b33-ddbfa2751c2d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 38197 microversion: 2.20 time: 0.087187 Aug 25 01:32:13.797660 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 350/718] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:13 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 38197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:14.336361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:14.337264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:14.343137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.343841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.344622 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.345063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.354557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-6ef136ad-8582-407b-96e7-d6d531cccc01 req-0574388b-6ece-4fea-9ef1-1e4ba74c84e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b31568-9ffd-49b4-a05e-f336ad399d88", "tag": "2b2e8cee-7b57-4858-8548-d09e9e90e699"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:14.357455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:14.357455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:14.369901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-6ef136ad-8582-407b-96e7-d6d531cccc01 req-0574388b-6ece-4fea-9ef1-1e4ba74c84e0 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.370573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-6ef136ad-8582-407b-96e7-d6d531cccc01 req-0574388b-6ece-4fea-9ef1-1e4ba74c84e0 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.384519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-6ef136ad-8582-407b-96e7-d6d531cccc01 req-0574388b-6ece-4fea-9ef1-1e4ba74c84e0 service nova] Creating event network-changed:2b2e8cee-7b57-4858-8548-d09e9e90e699 for instance c8b31568-9ffd-49b4-a05e-f336ad399d88 on hv-cinder-79001 Aug 25 01:32:14.390439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-6ef136ad-8582-407b-96e7-d6d531cccc01 req-0574388b-6ece-4fea-9ef1-1e4ba74c84e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043997 Aug 25 01:32:14.392185 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 351/719] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:32:14.412612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5daa9fef-77b4-4a51-a4bb-6c257d58d296 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.080385 Aug 25 01:32:14.416080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 369/720] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:14 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:14.810655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:14.812033 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:14.819098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.819790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.820747 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.821345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.894888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-20d9a312-3308-442e-a73c-75b7c470c4a4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 200 len: 38338 microversion: 2.20 time: 0.088854 Aug 25 01:32:14.895485 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 352/721] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:14 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 38338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:14.906640 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:14.907595 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:14.914443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.915142 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.916260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:14.916859 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:14.942974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1f48fa33-23d9-4b24-a195-4d6c75437583 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/ips" status: 200 len: 150 microversion: 2.20 time: 0.040231 Aug 25 01:32:14.944096 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 370/722] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Aug 25 01:32:14 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:15.425271 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:15.426326 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:15.433083 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:15.433782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:15.435245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:15.435875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:15.502414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-55e91ebe-0bf6-48fd-a46e-90c410cab10d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.081244 Aug 25 01:32:15.505501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 353/723] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:15 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:16.513550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:16.514455 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:16.520973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:16.521412 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:16.522218 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:16.522643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:16.585995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-64d37a0c-d151-40c2-9a24-056a8726646d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.076218 Aug 25 01:32:16.589262 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 371/724] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:16 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:17.069108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:17.069727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:17.077072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.077520 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.078492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.078968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.103199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lazy-loading 'flavor' on Instance uuid 4062759a-7420-4110-8d0c-77cbbc615973 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:32:17.393645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-aa7333ce-ec10-412e-b639-98ece327b922 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 202 len: 0 microversion: 2.20 time: 0.329772 Aug 25 01:32:17.395188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 354/725] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:17 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:32:17.407187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:17.408327 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:17.419262 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.420953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.423082 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.423698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.598211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:17.599282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:17.605758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.606211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.607128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:17.607559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:17.645271 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:17.653236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:17.654760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:17.655871 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-801e7b17-ce7a-4eea-9cfe-bce23dc81924 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.255780 Aug 25 01:32:17.657339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 372/726] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:17 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:17.671261 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-52329316-27ad-4ff6-b1cf-cc21976fce3f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.077606 Aug 25 01:32:17.674475 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 355/727] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:17 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:32:18.675347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:18.677212 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:18.682501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:18.683521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:18.686671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:18.688083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:18.688885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:18.689321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:18.690813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:18.691260 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:18.692020 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:18.692450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:18.769247 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e3adf535-078a-427b-8c61-a8daf0257e1b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.091243 Aug 25 01:32:18.770209 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 356/728] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:18 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:18.837484 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:18.855499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:18.857433 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:18.858828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8b66f277-fc0e-4b62-8092-187025952f60 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.187642 Aug 25 01:32:18.859629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 373/729] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:18 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:19.780570 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:19.782216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:19.789086 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:19.789831 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:19.790892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:19.791399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:19.856790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-304f558c-3a30-4560-936f-ee14f80963ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.080073 Aug 25 01:32:19.857643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 357/730] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:19 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:19.876957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:19.877774 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:19.884083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:19.884600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:19.885559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:19.886002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:20.027822 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:20.038549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:20.040099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:20.041226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4bd75fe6-3a31-4bef-a8c0-ff7b8373405a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.168056 Aug 25 01:32:20.041769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 374/731] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:19 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:20.870690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:20.876900 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:20.885258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:20.886209 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:20.887442 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:20.888771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:20.965334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8c2ef793-6083-4edd-bf4b-b8b985c7bddb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.098631 Aug 25 01:32:20.966257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 358/732] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:20 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:21.059728 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:21.060362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:21.066885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:21.067335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:21.068112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:21.071691 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:21.228374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:21.240917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:21.242844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:21.244239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1d3fc9b1-930a-4d0d-8ba8-c292e114150e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.188261 Aug 25 01:32:21.245321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 375/733] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:21 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:21.977925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:21.979715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:21.987412 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:21.988238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:21.989259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:21.989978 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:22.056655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1aaf74f9-0e8c-4f31-9440-593be7cee62a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.082452 Aug 25 01:32:22.057438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 359/734] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:21 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:22.266305 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:22.267126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:22.273796 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:22.274298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:22.275656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:22.277242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:22.502019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:22.510183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:22.511694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:22.513089 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-21608f0a-2a49-43a2-a46c-974878e7fa7b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.253796 Aug 25 01:32:22.513645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 376/735] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:22 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:23.070965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:23.073008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:23.079726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:23.080175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:23.080946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:23.081377 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:23.159230 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e493dabd-8dce-4b84-83b2-a44d783c85ba tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.094417 Aug 25 01:32:23.160131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 360/736] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:23 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:32:23.531957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:23.532477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:23.538397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:23.539058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:23.539842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:23.540281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:23.705962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:23.715665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:23.717412 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:23.730336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-43e0a731-47cb-4e3c-b6d3-88b85e3073c1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.190993 Aug 25 01:32:23.743476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 377/737] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:23 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:23.848090 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Action: 'create', calling method: .version_select at 0x7fd58e2fa670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1574037462"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:23.885899 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for project ada43be06e92474191038a2b41a9f39b. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:23.891751 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for user 2fba46fcf5a742d28b39d9fef9c91df5 and project ada43be06e92474191038a2b41a9f39b. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:24.267673 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:24.268627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:24.274452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:24.274931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:24.275683 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:24.276108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:24.342153 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3d520551-494a-4879-a706-706ba24d0105 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 14 microversion: 2.1 time: 0.175848 Aug 25 01:32:24.342731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 378/738] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:24 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:32:24.392099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for project ada43be06e92474191038a2b41a9f39b. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:24.395654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for user 2fba46fcf5a742d28b39d9fef9c91df5 and project ada43be06e92474191038a2b41a9f39b. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:24.408835 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-42d4482f-3157-40c6-9f3d-2681617a2e3c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.828079 Aug 25 01:32:24.409431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 361/739] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Aug 25 01:32:23 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:24.750255 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:24.750998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:24.757356 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:24.757796 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:24.758551 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:24.759026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:24.899269 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:24.908427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:24.909973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:24.911195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2cfc11d3-f4ad-448e-aeff-aabb539f2cee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.165577 Aug 25 01:32:24.911777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 379/740] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:24 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:25.353773 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:25.355031 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:25.362586 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:25.363072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:25.363897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:25.364276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:25.431093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bc9c10e1-288a-451e-8e5c-ce8f0c51ea35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 6964 microversion: 2.1 time: 0.081260 Aug 25 01:32:25.431709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 362/741] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:25 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 6964 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:25.930550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:25.931854 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:25.939002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:25.939452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:25.940329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:25.940769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:26.075816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:26.084108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:26.085683 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:26.087182 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-eec7c0f9-14f4-4e5b-ba59-e2283c2204e9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.161009 Aug 25 01:32:26.088061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 380/742] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:25 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:26.442813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:26.443830 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:26.450306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:26.450798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:26.451568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:26.452002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:26.547068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a646bda8-1d70-4ba5-a1c9-6d57ab812c35 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 15025 microversion: 2.1 time: 0.107968 Aug 25 01:32:26.547645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 363/743] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:26 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 15025 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:27.106245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:27.107126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:27.116045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:27.116561 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:27.117641 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:27.118267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:27.246115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:27.254545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:27.256248 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:27.257616 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5662da95-8909-4799-9a8e-b13c8def9478 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.155397 Aug 25 01:32:27.269189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 381/744] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:27 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:27.558254 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:27.559513 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:27.567883 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:27.568924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:27.569583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:27.570120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:27.652741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-25a9504c-8e4a-44f0-b229-cf83cf478191 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 18398 microversion: 2.1 time: 0.098504 Aug 25 01:32:27.653636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 364/745] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:27 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 18398 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:28.276728 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:28.277419 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:28.284639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:28.285123 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:28.285938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:28.286379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:28.414009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:28.422252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:28.423791 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:28.424937 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-38131242-af31-4576-948b-bfc707f9fd98 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.152016 Aug 25 01:32:28.425486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 382/746] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:28 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:28.665611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:28.666601 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:28.673081 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:28.673529 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:28.674359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:28.674808 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:28.742454 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c10b5961-57da-4049-be4d-df83a6a316b1 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 19342 microversion: 2.1 time: 0.080852 Aug 25 01:32:28.743123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 365/747] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:28 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 19342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:29.443689 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:29.444349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:29.451081 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:29.451443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:29.452231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:29.453311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:29.578391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:29.586623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:29.588201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:29.589339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2236af35-ef92-487e-827c-a04fd80b4f02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.149563 Aug 25 01:32:29.589888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 383/748] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:29 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:29.755126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:29.756030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:29.762766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:29.763220 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:29.763974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:29.764406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:29.844771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c0dd0f5f-4324-48dd-925a-a0e5d8c926ee tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 21972 microversion: 2.1 time: 0.093617 Aug 25 01:32:29.846012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 366/749] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:29 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 21972 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:30.607600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:30.608206 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:30.614085 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:30.614537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:30.615340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:30.615777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:30.735292 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:30.742885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:30.744373 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:30.745487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-54e6d449-95fb-4ca8-82b6-72dc9ce91e0b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.141612 Aug 25 01:32:30.746030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 384/750] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:30 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:30.857062 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:30.858059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:30.864565 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:30.865003 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:30.865757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:30.866272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:30.939269 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4a1d73a8-943b-4657-974e-6c1171e9b333 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 23234 microversion: 2.1 time: 0.085906 Aug 25 01:32:30.939908 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 367/751] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:30 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 23234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:31.764372 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:31.764931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:31.770856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:31.771317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:31.772076 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:31.772515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:31.893849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:31.901518 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:31.903052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:31.904186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8a03bfe6-c558-472b-a250-4a308966a0df tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.143906 Aug 25 01:32:31.904735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 385/752] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:31 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:31.951315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:31.952857 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:31.959315 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:31.959799 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:31.960564 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:31.961011 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:32.032535 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fde2743a-83c5-4e59-9cd5-4c0b3ac40df2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 24694 microversion: 2.1 time: 0.084350 Aug 25 01:32:32.033065 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 368/753] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:31 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 24694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:32.922423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:32.923086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:32.929244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:32.929685 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:32.930432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:32.930899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:33.044447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:33.045463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:33.052343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:33.052784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:33.053537 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:33.053964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:33.059097 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:33.067091 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:33.068580 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:33.069789 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0d52603c-b9f5-4f4a-b846-ea9f1a90e511 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.151591 Aug 25 01:32:33.070337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 386/754] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:32 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:33.134136 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a7e5cd47-d5fc-495e-9b2c-981f34674efb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 25956 microversion: 2.1 time: 0.093536 Aug 25 01:32:33.135568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 369/755] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:33 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 25956 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:34.087814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:34.088412 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:34.094220 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:34.094660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:34.095432 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:34.095859 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:34.146080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:34.147110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:34.153929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:34.154380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:34.155190 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:34.155627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:34.215953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:34.224469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:34.225978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:34.227160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7796672b-b3dd-402d-b246-0061789a9184 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1742 microversion: 2.20 time: 0.142996 Aug 25 01:32:34.227716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 387/756] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:34 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1742 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:34.240849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7dc427b4-b0f7-45e1-9756-e7d16a9aa520 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 26963 microversion: 2.1 time: 0.098835 Aug 25 01:32:34.241507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 370/757] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:34 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 26963 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:35.245434 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:35.246042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:35.253574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:35.254029 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:35.254398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:35.255386 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:35.255828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:35.256736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:35.265060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:35.265934 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:35.267432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:35.268140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:35.366860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-dd3c248f-038b-467d-a19d-5364ce82294f tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 27646 microversion: 2.1 time: 0.117953 Aug 25 01:32:35.368137 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 371/758] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:35 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 27646 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:35.400974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:35.408820 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:35.410408 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:35.411662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2c62f9aa-376b-4b25-a407-dc5de04b2777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1742 microversion: 2.20 time: 0.169945 Aug 25 01:32:35.412208 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 388/759] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:35 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:36.380181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:36.381970 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:36.388969 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:36.389838 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:36.390383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:36.390867 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:36.430441 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:36.431257 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:36.437329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:36.437771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:36.439068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:36.439522 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:36.472387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e30e8925-f101-436d-918d-9103db10e764 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28061 microversion: 2.1 time: 0.096656 Aug 25 01:32:36.473332 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 372/760] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:36 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28061 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:36.597099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:36.605980 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:36.607974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:36.609229 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a8a36520-58f9-448d-974a-0c8a01e374f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.183831 Aug 25 01:32:36.610111 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 389/761] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:36 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:37.308498 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-922898ce-bf38-4c02-afff-0fd9ce96243d req-c4502560-26d3-4657-8c24-2da8dffc48b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "name": "network-vif-plugged", "status": "completed", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:37.310146 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:37.310146 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:37.319366 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-922898ce-bf38-4c02-afff-0fd9ce96243d req-c4502560-26d3-4657-8c24-2da8dffc48b2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:37.320121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-922898ce-bf38-4c02-afff-0fd9ce96243d req-c4502560-26d3-4657-8c24-2da8dffc48b2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:37.334383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-922898ce-bf38-4c02-afff-0fd9ce96243d req-c4502560-26d3-4657-8c24-2da8dffc48b2 service nova] Creating event network-vif-plugged:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:32:37.341392 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-922898ce-bf38-4c02-afff-0fd9ce96243d req-c4502560-26d3-4657-8c24-2da8dffc48b2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102661 Aug 25 01:32:37.343109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 373/762] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:32:37.484231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:37.485142 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:37.491897 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:37.492602 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:37.493700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:37.494710 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:37.575224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2e1fa7be-6505-48cf-8283-62b3836bf727 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28247 microversion: 2.1 time: 0.094345 Aug 25 01:32:37.576123 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 390/763] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:37 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:37.630013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:37.631502 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:37.637946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:37.638431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:37.639233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:37.639975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:37.814613 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:37.822873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:37.824865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:37.826331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a204ebaa-f4e6-47c2-b40c-e9366ba45431 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.200632 Aug 25 01:32:37.838152 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 374/764] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:37 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:38.588634 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:38.589660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:38.597296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:38.597734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:38.598520 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:38.598974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:38.664450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d18e78aa-ce52-4a03-a3ec-359af464dce2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28247 microversion: 2.1 time: 0.079736 Aug 25 01:32:38.666090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 391/765] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:38 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:38.845930 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:38.846543 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:38.855929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:38.857075 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:38.858248 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:38.859054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:39.004428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:39.015623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:39.017678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:39.018817 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2fc351dc-f38f-4426-b976-63972cbc3440 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.177523 Aug 25 01:32:39.019452 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 375/766] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:38 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:39.679181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:39.680194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:39.686960 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:39.687639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:39.689089 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:39.689716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:39.762880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a38c128b-ce64-40d5-9201-99d297902d54 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28247 microversion: 2.1 time: 0.087558 Aug 25 01:32:39.764041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 392/767] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:39 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28247 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:40.037407 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:40.038033 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:40.044187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:40.044639 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:40.045417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:40.046043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:40.190504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:40.198969 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:40.200743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:40.202231 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ab218415-a598-4950-8af8-1c22544b564f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.169020 Aug 25 01:32:40.202967 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 376/768] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:40 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:40.775086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:40.776002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:40.783254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:40.783726 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:40.784501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:40.784935 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:40.857079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1a19a6b0-246f-4a04-8ff1-aadf70fe4bc2 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28538 microversion: 2.1 time: 0.085846 Aug 25 01:32:40.857759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 393/769] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:40 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28538 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:41.220348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:41.221645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:41.228209 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:41.228669 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:41.229469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:41.229909 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:41.357278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:41.365787 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:41.367317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:41.368455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2963e847-1e75-4bf4-ac93-2f9678671bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.151927 Aug 25 01:32:41.369716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 377/770] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:41 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:41.869588 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:41.870507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:41.877781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:41.878210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:41.879066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:41.879497 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:41.943351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5cc1e7bc-793a-480e-a705-4b54df515817 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28538 microversion: 2.1 time: 0.077834 Aug 25 01:32:41.947860 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 394/771] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:41 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28538 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:42.387532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:42.388272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:42.395784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:42.396473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:42.397439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:42.397868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:42.530798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:42.541022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:42.541022 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:42.542115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9a67a2e1-fad4-4adc-99ce-475abca4c957 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.159080 Aug 25 01:32:42.542708 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 378/772] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:42 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:42.779580 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1827555635", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1574037462", "security_groups": [{"name": "tempest-secgroup-smoke-1998696762"}], "block_device_mapping_v2": [{"uuid": "039e3150-5ac8-4fa4-9134-5d105d8bf1ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "109ccc69-61fe-42e8-83da-81c7da1807b8"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:42.898494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] validate_networks() for [('109ccc69-61fe-42e8-83da-81c7da1807b8', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:32:42.955144 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:42.957679 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:42.969109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:42.969847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:42.970999 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:42.971551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:43.058119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-18e3c213-4081-4ad3-adee-e1ead8fb6f3a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28706 microversion: 2.1 time: 0.106439 Aug 25 01:32:43.063182 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 379/773] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:42 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28706 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:43.395362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:32:43.396101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:32:43.396801 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:32:43.399403 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:32:43.399403 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:32:43.407283 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:43.408054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:43.409074 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:43.409577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:43.427611 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:32:43.431674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for user 2fba46fcf5a742d28b39d9fef9c91df5 and project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:32:43.505436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:32:43.506595 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='039e3150-5ac8-4fa4-9134-5d105d8bf1ee',volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:32:43.567029 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:43.567731 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:43.574538 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:43.575093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:43.575943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:43.576474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:43.680792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d5375341-b856-47f4-856d-a310de652a71 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.904523 Aug 25 01:32:43.682095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 395/774] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:32:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:32:43.702453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-722f0065-cd2e-458f-9457-c60e8278a863 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:43.703236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-722f0065-cd2e-458f-9457-c60e8278a863 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:43.785374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-722f0065-cd2e-458f-9457-c60e8278a863 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:43.792656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-722f0065-cd2e-458f-9457-c60e8278a863 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1095 microversion: 2.1 time: 0.104339 Aug 25 01:32:43.798723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 396/775] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:43 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1095 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:43.812165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:43.821505 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:43.823238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:43.824375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ee836f55-8f4f-4194-bc3c-0ec6a155ee47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.267087 Aug 25 01:32:43.825079 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 380/776] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:43 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:44.069679 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:44.071337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:44.078501 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.079339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.083573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.084016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.160174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-94b4e265-0c53-4a93-a6be-265a10d2da70 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28706 microversion: 2.1 time: 0.094061 Aug 25 01:32:44.165576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 397/777] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:44 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28706 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:44.809742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:44.810638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:44.823189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.823952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.824943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.825636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.844447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:44.845988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:44.856188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.856821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.857848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:44.858600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:44.901453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:44.913030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fec6e776-3ecb-416f-b11d-207893ba2073 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1193 microversion: 2.1 time: 0.106974 Aug 25 01:32:44.922841 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 381/778] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:44 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:45.022044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:45.032793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:45.039233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:45.041046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f5fb7eef-5f76-48ce-95be-d7b4a7c5a07c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.201397 Aug 25 01:32:45.052757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 398/779] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:44 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:45.173772 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:45.175014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:45.183158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.183882 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.184827 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.185419 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.255880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-593fbe0b-a7c8-42dd-917c-a1fa3f89d93b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28706 microversion: 2.1 time: 0.086447 Aug 25 01:32:45.256826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 382/780] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:45 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28706 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:45.368847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:45.370080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:45.380027 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.380785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.381959 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.382610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.423568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lazy-loading 'flavor' on Instance uuid 534244b4-6d9f-4918-b1e1-3ea057e19cbf {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:32:45.552399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a8ef8b19-c272-42c9-a16c-15a3ba4ca792 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "POST /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf/action" status: 202 len: 0 microversion: 2.1 time: 0.187297 Aug 25 01:32:45.557159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 399/781] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:45 2021] POST /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:32:45.562648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:45.563697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:45.570916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.571608 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.572559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.573144 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.722243 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:45.732330 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ccc75ef2-31ab-49e3-bd91-eed11f429702 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.173903 Aug 25 01:32:45.743129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 383/782] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:45 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:45.930194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:45.931312 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:45.937351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.937873 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:45.938794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:45.939300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.059922 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:46.060528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:46.061160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:46.066974 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.067646 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.068427 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.068871 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.068995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-19186c7a-1ae3-42c6-8e53-c44bcd9a9126 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.143288 Aug 25 01:32:46.075943 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 400/783] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:45 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:46.200117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:46.208306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:46.209832 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:46.211012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d61a64b0-215c-436f-970d-073d68d097fa tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1737 microversion: 2.20 time: 0.155222 Aug 25 01:32:46.211572 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 384/784] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:46 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:46.268273 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:46.269539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:46.275968 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.276681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.277688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.278127 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.349330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-736c177d-53af-4e29-9afb-68b6d747a442 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 28706 microversion: 2.1 time: 0.084417 Aug 25 01:32:46.350260 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 401/785] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:46 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 28706 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:46.699034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-c7fb7c63-63cc-4479-9c15-274292202d72 req-93c979db-8143-46d5-9d5f-f0ae5bcac8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311b6a44-51eb-49e3-aee1-e24c57a2d392", "tag": "336c249f-6762-4e80-a90d-fd9c1dc12af8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:46.700625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:46.700625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:46.708432 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c7fb7c63-63cc-4479-9c15-274292202d72 req-93c979db-8143-46d5-9d5f-f0ae5bcac8f0 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.709074 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-c7fb7c63-63cc-4479-9c15-274292202d72 req-93c979db-8143-46d5-9d5f-f0ae5bcac8f0 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.727114 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-c7fb7c63-63cc-4479-9c15-274292202d72 req-93c979db-8143-46d5-9d5f-f0ae5bcac8f0 service nova] Creating event network-changed:336c249f-6762-4e80-a90d-fd9c1dc12af8 for instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 on hv-cinder-79001 Aug 25 01:32:46.733030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-c7fb7c63-63cc-4479-9c15-274292202d72 req-93c979db-8143-46d5-9d5f-f0ae5bcac8f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108348 Aug 25 01:32:46.733785 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 385/786] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:32:46.749866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:46.750574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:46.757795 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.758499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.759400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:46.759911 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:46.894993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:46.902877 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c2f2c6f6-a012-4cbe-ab12-7e05bdb070b9 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.156978 Aug 25 01:32:46.903469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 402/787] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:46 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:47.086342 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:47.087157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:47.093098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.093547 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.094419 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.094891 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.212761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:47.219925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fb226a41-ae47-4222-9896-92d9d37223fb tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.137549 Aug 25 01:32:47.220515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 386/788] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:47 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:47.229003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:47.229681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:47.236003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.236449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.237201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.237628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.356390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:47.361214 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:47.362246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:47.364775 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:47.366724 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:47.367873 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-28a7430c-9a65-48b8-ab38-9b0358d26b17 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1719 microversion: 2.20 time: 0.142568 Aug 25 01:32:47.368423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 403/789] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:47 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1719 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:47.368561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.369085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.369931 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.370405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.448155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2a70b936-a113-43d2-a722-a71c73e8b22a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 29437 microversion: 2.1 time: 0.091038 Aug 25 01:32:47.452194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 387/790] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:47 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 29437 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:47.920405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:47.921014 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:47.927805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.928249 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:47.929012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:47.929442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.052328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:48.059872 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5f462cdf-a27e-4655-acea-2f601b4c825c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.143177 Aug 25 01:32:48.060434 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 404/791] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:47 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:48.236718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:48.237409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:48.243813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.244265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.245023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.245464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.363377 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:48.370476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d3877fdd-6a9b-4c31-9ef2-c5b1c30e19a8 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.137761 Aug 25 01:32:48.371074 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 388/792] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:48 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:48.385952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:48.386554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:48.393093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.393532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.394282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.394759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.460475 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:48.461374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:48.467036 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.467479 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.468235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:48.468663 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:48.512138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:48.520494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:48.521983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:48.523189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-000b8558-5bb6-4a5d-b27e-d20e48073f55 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1719 microversion: 2.20 time: 0.140818 Aug 25 01:32:48.523736 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 405/793] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:48 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1719 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:48.547056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-537dc8a5-b11d-4f97-bc76-fc61737f1b46 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 30967 microversion: 2.1 time: 0.089993 Aug 25 01:32:48.547717 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 389/794] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:48 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 30967 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:49.076703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:49.077271 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:49.083155 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.083612 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.084453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.084805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.205691 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-9c1cfd41-af89-4824-af16-12d42fbfc51a req-83f170b3-0379-415d-abef-75839a7fce68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "name": "network-vif-unplugged", "status": "completed", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:49.207374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:32:49.207374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:32:49.215567 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:49.216894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9c1cfd41-af89-4824-af16-12d42fbfc51a req-83f170b3-0379-415d-abef-75839a7fce68 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.217894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9c1cfd41-af89-4824-af16-12d42fbfc51a req-83f170b3-0379-415d-abef-75839a7fce68 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.223152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e6d0c84c-1b90-497e-9e81-0cbca045d8ce tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.150074 Aug 25 01:32:49.223948 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 406/795] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:49 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:49.232554 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-9c1cfd41-af89-4824-af16-12d42fbfc51a req-83f170b3-0379-415d-abef-75839a7fce68 service nova] Creating event network-vif-unplugged:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:32:49.238132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-9c1cfd41-af89-4824-af16-12d42fbfc51a req-83f170b3-0379-415d-abef-75839a7fce68 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037556 Aug 25 01:32:49.238869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 390/796] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:32:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:32:49.387842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:49.388431 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:49.394944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.395387 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.396149 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.396579 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.516498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:49.524214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cfd27a09-4bba-43ee-9bb7-acfe8d59bcbc tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.140377 Aug 25 01:32:49.524776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 407/797] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:49 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:49.541570 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:49.542451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:49.549320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.549845 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.550832 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.551270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.559473 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:49.560673 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:49.567702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.568143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.569256 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.569458 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.644025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5c255a54-76e9-44fe-9ec5-4ff89bc63776 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 32580 microversion: 2.1 time: 0.089884 Aug 25 01:32:49.647978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 408/798] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:49 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 32580 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:49.677106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:49.684755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:49.686313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:49.687477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-91542bf2-21e1-4a50-8f8d-748e19f0fea5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1662 microversion: 2.20 time: 0.150026 Aug 25 01:32:49.688031 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 391/799] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:49 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:49.705725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96134619-6e33-4cf4-b250-436df46c4312"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:49.706924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:49.713382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.713833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.714698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:49.715139 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:49.973777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1af08993-d49d-424e-a556-ffad43485ec1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.272251 Aug 25 01:32:49.974379 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 409/800] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Aug 25 01:32:49 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:50.091180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:50.091752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:50.098015 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.098463 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.099259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.099697 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.175184 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-864ff98c-f4de-43d0-8ebf-292054d8554e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action" status: 202 len: 0 microversion: 2.20 time: 0.087737 Aug 25 01:32:50.175689 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 392/801] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:32:50 2021] POST /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:32:50.183508 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:50.184124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:50.191043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.191500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.192276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.192713 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.241363 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:50.241982 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:50.248172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.248901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.249955 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.251186 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.348430 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:50.356770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:50.358325 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:50.359496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d22c5a84-3d7c-4be0-a5bb-013c05ba8030 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1748 microversion: 2.20 time: 0.179758 Aug 25 01:32:50.370768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 410/802] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:50 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1748 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:50.405424 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:50.412716 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-72980f0b-7379-4120-be67-64e3897f2614 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.175656 Aug 25 01:32:50.413278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 393/803] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:50 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:50.540680 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:50.541294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:50.547877 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.548377 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.549138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.549572 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.655566 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:50.657203 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:50.663430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.663973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.664849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:50.665356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:50.668489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:50.680544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3b1f2ec2-881b-4b52-981b-adb197554dcf tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.143328 Aug 25 01:32:50.681209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 411/804] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:50 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:50.752812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a79d862f-07e6-4268-ae38-d707be5c5885 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 33662 microversion: 2.1 time: 0.100846 Aug 25 01:32:50.753434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 394/805] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:50 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 33662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:32:51.377841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:51.379130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:51.385849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.386294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.387353 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.387779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.430231 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:51.431053 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:51.438766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.439218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.439992 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.440431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.758036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:51.766852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:51.768339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:51.769472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3ad5867f-844d-49c6-adee-d4685dc28406 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1750 microversion: 2.20 time: 0.395872 Aug 25 01:32:51.770025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 412/806] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:51 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1750 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:51.774117 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:51.774739 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:51.780167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.780613 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.781372 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.781801 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.793997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:51.801808 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2d4a8513-5620-48c9-b4a5-8b47c18d3fd4 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.375599 Aug 25 01:32:51.802466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 395/807] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:51 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:51.806865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:51.807840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:51.814170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.814625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.815420 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:51.815858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:51.903032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ea69b447-3c2b-4508-b826-7bfeca0eb459 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 34819 microversion: 2.1 time: 0.099183 Aug 25 01:32:51.904765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 396/808] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:51 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 34819 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:32:51.907576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:51.914824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cd0caad7-4999-4f7a-b8f7-41b22c232b53 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.143819 Aug 25 01:32:51.915541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 413/809] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:51 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:52.788987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:52.789678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:52.797464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:52.798255 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:52.799281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:52.799943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:52.819033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:52.826819 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:52.839032 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:52.839911 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:52.841785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:52.843729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:53.017881 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:53.027132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:53.029032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:53.030299 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5a53a425-4449-4dd1-9c52-2483f85ed3bd tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.245315 Aug 25 01:32:53.031132 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 397/810] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:52 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:32:53.036087 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:32:53.037246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:53.043293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:53.043813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:53.044742 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:53.045170 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:53.067289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:53.074963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f7d363f4-1e6f-4f8a-9f47-514e781d8e11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.259838 Aug 25 01:32:53.082295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 414/811] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:52 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:53.085828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:53.086637 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:53.092678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:53.093360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:53.094160 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:53.094598 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:53.226052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:53.233223 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-99e83b1c-16f9-413c-bb55-2b764cbbdc28 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.151319 Aug 25 01:32:53.233776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 415/812] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:53 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:54.048669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:54.049347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:54.055601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.056052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.056819 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.057255 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.190998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:54.200848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:54.202326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:54.204007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1317b75e-0dda-4a37-b9c8-fc2ba48f754b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.158588 Aug 25 01:32:54.204567 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 416/813] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:54 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:54.217696 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:54.218325 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:54.225002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.225453 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.226254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.226669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.345954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:54.353330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-48285418-7c40-45d7-8fd8-c583d3266ad5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.147785 Aug 25 01:32:54.354107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 417/814] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:54 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:54.367450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:54.368064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:54.374061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.374517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.375821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:54.379285 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:54.513392 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:54.521466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-28de1677-6d8a-43b1-b6ea-1cd98c6ac48c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.157689 Aug 25 01:32:54.522038 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 418/815] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:54 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:55.222365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:55.223059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:55.228851 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.229303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.230063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.230494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.353914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:55.363496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:55.364984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:55.366560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4c25c33a-dcd9-4e05-84ad-3968b963915c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.148384 Aug 25 01:32:55.367149 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 419/816] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:55 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:55.371424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:55.372011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:55.378133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.378596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.379381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.379837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.502556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:55.509994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-521bb60a-f494-4d03-8b93-fec958e4a937 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.141896 Aug 25 01:32:55.510556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 420/817] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:55 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:55.537618 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:55.538228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:55.544303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.544774 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.545539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:55.545966 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:55.671012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:55.678532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4bccdaba-d81e-4799-95c3-04005b3bfd8f tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.144460 Aug 25 01:32:55.679138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 421/818] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:55 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:56.387395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:56.388233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:56.394433 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.395240 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.396053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.396554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.521890 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:56.529976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:56.531507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:56.532624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-776d985d-4292-4b02-84f2-1bf52ee431ba tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.151017 Aug 25 01:32:56.533171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 422/819] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:56 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:56.537300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:56.537899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:56.543143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.543579 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.544324 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.544748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.671338 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:56.680162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-765677e4-bf14-49e5-b657-744798b3fae2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.145975 Aug 25 01:32:56.680994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 423/820] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:56 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:56.694653 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:56.695282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:56.701042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.701492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.702282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:56.702734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:56.828924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:56.837348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0252446b-1486-4f9a-b48d-79025b26e087 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.145926 Aug 25 01:32:56.838167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 424/821] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:56 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:57.551549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:57.552215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:57.558347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.558833 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:57.559625 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.560092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:57.684995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:57.694479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:57.696003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:57.697148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f2e997e8-b511-4a81-ab49-e9731bb2779c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.149893 Aug 25 01:32:57.697699 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 425/822] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:57 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:57.703023 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:57.704186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:57.710080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.710524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:57.711338 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.711774 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:57.835013 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:57.842213 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a1f4b6c1-06a6-4eb4-9dbe-1b2623d64be1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.143588 Aug 25 01:32:57.842799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 426/823] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:57 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:57.855978 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:57.856600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:57.862668 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.863150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:57.863927 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:57.864365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:58.001287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:58.008700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cb9e383c-2ab5-4e5c-8e72-9735c3b43824 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.157225 Aug 25 01:32:58.009254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 427/824] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:57 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:58.715287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:58.716040 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:58.722714 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:58.723504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:58.724337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:58.724838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:58.850031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:58.861312 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:58.862852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:58.864006 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e83c8722-f518-445b-a2d8-60be0d674d70 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.152555 Aug 25 01:32:58.864565 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 428/825] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:58 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:32:58.868751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:58.869358 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:58.875678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:58.876098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:58.876865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:58.877300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:58.999486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:59.007463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3130d984-a32b-494c-b531-f436eed2ea6d tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.141851 Aug 25 01:32:59.008032 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 429/826] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:58 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:32:59.025936 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:59.026809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:59.033417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:59.033858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:59.034656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:59.035133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:59.162768 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:32:59.170212 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0390bdc1-77df-4ddf-8ceb-05fc6c69c587 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.148499 Aug 25 01:32:59.171031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 430/827] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:32:59 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:32:59.881291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:32:59.881995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:32:59.895374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:59.895855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:32:59.896657 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:32:59.897094 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:00.022630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:00.030847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:00.032965 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:00.034095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e0d7e6f3-ac0c-4c79-9d5d-d29bae0d2340 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.156645 Aug 25 01:33:00.034653 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 431/828] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:32:59 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:00.038769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:00.039376 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:00.044639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:00.045086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:00.045845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:00.046279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:00.174884 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:00.182465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fe23c225-d86b-4a1d-8450-26e8d685d9b0 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.146847 Aug 25 01:33:00.183050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 432/829] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:00 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:00.187255 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:00.187926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:00.193404 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:00.193849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:00.194605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:00.195066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:00.322661 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:00.330944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1b19274a-2a80-4c70-99fd-ccf8b872518b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.146749 Aug 25 01:33:00.331703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 433/830] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:00 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:01.052610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:01.053326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:01.059033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.059487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.060244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.060678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.186895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:01.200269 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:01.201770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:01.202949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-25287448-bd16-42d9-b6d8-1f95b00fea25 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.154126 Aug 25 01:33:01.203541 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 434/831] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:01 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:33:01.207976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:01.208582 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:01.214316 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.214793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.215583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.216016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.338924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:01.348721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-abc1501d-045a-4a46-9902-892a813c2379 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.144143 Aug 25 01:33:01.349308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 435/832] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:01 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:01.353537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:01.354314 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:01.361348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.361887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.362823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:01.363347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:01.491588 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:01.498748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1ecdb0d8-9af5-45ee-ab6d-1a866bbc4bff tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.148474 Aug 25 01:33:01.499309 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 436/833] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:01 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:02.221216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:02.221926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:02.227979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.228431 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.229225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.229656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.358402 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:02.367182 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:02.368674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:02.369798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-56249cb8-050b-41b8-bd46-635758f30ac2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.152370 Aug 25 01:33:02.370347 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 437/834] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:02 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:33:02.374431 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:02.375055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:02.380930 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.381374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.382161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.382592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.503751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:02.513947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4fb3751e-37a8-4440-a5ee-b15a6e02ccba tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.142541 Aug 25 01:33:02.528237 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 438/835] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:02 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:02.531255 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:02.531841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:02.538098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.538544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.539351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:02.539783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:02.669445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:02.682002 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1b0fcc63-b3ff-49f5-a35d-8258d2f158f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.153707 Aug 25 01:33:02.683554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 439/836] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:02 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:03.388597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:03.389311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:03.396413 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.396898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.397682 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.398120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.527424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:03.535533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:03.537017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:03.538174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-389f8f37-12f4-421d-ae20-8c89c9ef5309 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.153595 Aug 25 01:33:03.538747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 440/837] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:03 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:33:03.543702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:03.544297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:03.549626 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.550067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.550845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.551273 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.675516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:03.683115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3eaf40ed-e9b8-408a-86ea-7aa601a66855 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.142615 Aug 25 01:33:03.683681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 441/838] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:03 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:03.698725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:03.699326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:03.705690 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.706143 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.706941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:03.707746 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:03.834215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:03.841486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8b97883c-d75b-4d79-8c05-61279a5af457 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.146096 Aug 25 01:33:03.842093 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 442/839] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:03 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:04.528499 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b38205fd-d720-4ea7-a56e-7b5998b89acd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action" status: 200 len: 38362 microversion: 2.1 time: 11.495694 Aug 25 01:33:04.529135 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 398/840] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:32:53 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/action => generated 38362 bytes in 11497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:33:04.538952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:04.539449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:04.545270 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.545724 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.546491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.547460 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.557303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:04.558000 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:04.564952 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.565407 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.566178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.566631 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.571361 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d055f58c-4725-439e-998b-08a988c8d3d8 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/ips" status: 200 len: 146 microversion: 2.1 time: 0.036005 Aug 25 01:33:04.571935 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 443/841] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:33:04 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:04.700802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:04.701427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:04.702101 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:04.709061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.709663 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.710756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.711207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.715314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:04.716940 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:04.718298 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c8b27def-ce12-4077-a07e-00b2735226ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.165080 Aug 25 01:33:04.719492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 399/842] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:04 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:33:04.856728 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:04.858093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:04.859016 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:04.864063 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-47798d0d-ce85-4387-a6f1-39548809de19 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.167483 Aug 25 01:33:04.873472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 444/843] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:04 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:04.873662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.873662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.873662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:04.873662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:04.994169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:05.001453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-114e8bf2-2acf-49fa-9159-b9ba0eb92c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.147095 Aug 25 01:33:05.002016 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 400/844] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:04 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:05.737083 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:05.737694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:05.743651 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.744122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:05.744919 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.745355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:05.865008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:05.872552 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:05.874075 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:05.875701 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cd3de17c-34c4-4ad4-8c49-45a3ceba38a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.142495 Aug 25 01:33:05.876257 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 445/845] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:05 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:05.880310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:05.880920 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:05.887494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.887945 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:05.888713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.889151 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:05.915716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d021d88d-6ce7-4cac-a53b-cc2ff6a727c8"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:05.916885 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:05.923573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.924016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:05.924781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:05.925209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:06.010406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:06.018984 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-db7fb292-ed25-4d38-96c9-eb975ddef07e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.142293 Aug 25 01:33:06.019579 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 401/846] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:05 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:06.023962 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:06.024573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:06.030263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:06.030766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:06.032137 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:06.032565 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:06.157596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:06.160226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-3a3e75e7-1962-4c7a-aab6-ac5a64fd3b3c tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248022 Aug 25 01:33:06.160837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 446/847] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:33:05 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:33:06.164935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-022126f0-836a-49b2-b0c8-3ee3a6d3660c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.144405 Aug 25 01:33:06.165576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 402/848] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:06 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:06.893949 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:06.894692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:06.900721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:06.901189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:06.901951 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:06.902388 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.027659 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:07.035564 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:07.036180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:07.041941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:07.042482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.043352 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:07.043808 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:07.043975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.045289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:07.046424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c6034e95-9f09-49d5-a4d4-e9cfce06c816 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.156604 Aug 25 01:33:07.047718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 447/849] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:06 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:07.174311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:07.181094 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:07.181562 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8aba7c71-fcc2-434d-a709-7b16b99402f3 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.149608 Aug 25 01:33:07.181721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:07.182120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 403/850] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:07 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:07.188609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:07.189114 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.189855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:07.190279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.314759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:07.322052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-556819c3-7817-432c-832f-cda7eada4641 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.144579 Aug 25 01:33:07.322630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 448/851] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:07 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:07.365359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-a0500d28-3731-4305-a528-75a2a3b82c51 req-091670e7-14e7-416c-bb82-2bfdb7bfee4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311b6a44-51eb-49e3-aee1-e24c57a2d392", "name": "network-vif-plugged", "status": "completed", "tag": "336c249f-6762-4e80-a90d-fd9c1dc12af8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:07.367167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:07.367167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:33:07.375935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a0500d28-3731-4305-a528-75a2a3b82c51 req-091670e7-14e7-416c-bb82-2bfdb7bfee4c service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:07.376598 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-a0500d28-3731-4305-a528-75a2a3b82c51 req-091670e7-14e7-416c-bb82-2bfdb7bfee4c service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:07.388801 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-a0500d28-3731-4305-a528-75a2a3b82c51 req-091670e7-14e7-416c-bb82-2bfdb7bfee4c service nova] Creating event network-vif-plugged:336c249f-6762-4e80-a90d-fd9c1dc12af8 for instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 on hv-cinder-79001 Aug 25 01:33:07.395150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-a0500d28-3731-4305-a528-75a2a3b82c51 req-091670e7-14e7-416c-bb82-2bfdb7bfee4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 Aug 25 01:33:07.396257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 404/852] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:08.064623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:08.065233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:08.070987 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.071436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.072193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.072623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.188853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.196866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.198344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.199460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:08.199940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ff4e51fd-5ce2-4721-8f8c-26fdec933fe7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.138755 Aug 25 01:33:08.200044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 449/853] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:08 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:08.200193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:08.206873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.207427 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.208257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.208762 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.325587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.333410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b0bc7659-c0f6-4fd1-8eea-a062d08d423a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1508 microversion: 2.1 time: 0.137840 Aug 25 01:33:08.334013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 405/854] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:08 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:08.338329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:08.338976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:08.345380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.345830 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.346659 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.347118 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.350046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:08.350611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:08.356258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.356706 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.357476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.357907 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.431034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-99bd3336-3715-4bbd-a14b-5750c2b8a729 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "POST /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf/action" status: 202 len: 0 microversion: 2.1 time: 0.084775 Aug 25 01:33:08.431651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 406/855] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:33:08 2021] POST /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:33:08.439106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:08.439717 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:08.445658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.446111 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.446916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:08.447357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:08.481849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.489983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2a7da370-e269-435b-93bb-95885bdc94f2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1267 microversion: 2.1 time: 0.155159 Aug 25 01:33:08.494057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 450/856] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:08 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:08.573570 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:08.581285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d8f822a5-b2eb-4c8d-833d-7c581aebc4b8 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1516 microversion: 2.1 time: 0.145618 Aug 25 01:33:08.581843 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 407/857] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:08 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:09.216998 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:09.217608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:09.223837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.224281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.225036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.225469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.341459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.350008 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.351532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.352663 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-38cc57f8-55b2-4cdf-b444-cab55dfff44a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.139309 Aug 25 01:33:09.353215 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 451/858] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:09 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:09.410943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-00169c4a-8f84-40e8-a059-e3d47373dd98 req-84539df0-ca34-40c7-b0c4-0e20bb469ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "name": "network-vif-unplugged", "status": "completed", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:09.412450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:09.412450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:33:09.419116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-00169c4a-8f84-40e8-a059-e3d47373dd98 req-84539df0-ca34-40c7-b0c4-0e20bb469ec9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.419554 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-00169c4a-8f84-40e8-a059-e3d47373dd98 req-84539df0-ca34-40c7-b0c4-0e20bb469ec9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.430573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.compute.server_external_events [req-00169c4a-8f84-40e8-a059-e3d47373dd98 req-84539df0-ca34-40c7-b0c4-0e20bb469ec9 service nova] Unable to find a host for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf. Dropping event network-vif-unplugged {{(pid=108270) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 25 01:33:09.431429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-00169c4a-8f84-40e8-a059-e3d47373dd98 req-84539df0-ca34-40c7-b0c4-0e20bb469ec9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024188 Aug 25 01:33:09.432088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 408/859] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 01:33:09.506368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:09.506942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:09.513025 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.513479 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.514237 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.514688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.598958 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:09.599658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:09.605565 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.606100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.606990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.607501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.634231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.641936 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-172b4d7c-9e4b-4109-9b54-df1bffe8e508 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1453 microversion: 2.1 time: 0.139361 Aug 25 01:33:09.642502 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 452/860] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:09 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:09.657698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:09.658301 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:09.664112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.664551 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.665303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:09.665863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:09.752707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.760110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-13afbb1a-8459-4fa7-8667-c8f3fa439ff2 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1518 microversion: 2.1 time: 0.164671 Aug 25 01:33:09.760690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 409/861] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:09 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:09.803161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:09.810316 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-601c00f3-c2f6-4ec0-b6db-7bc22b77edcd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1453 microversion: 2.1 time: 0.156607 Aug 25 01:33:09.810900 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 453/862] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:09 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:10.371401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:10.371985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:10.378404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:10.378894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:10.379690 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:10.380145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:10.641399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:10.649549 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:10.651104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:10.652266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6b48e804-190d-4a8d-a850-781f0a9a9bd8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.284688 Aug 25 01:33:10.652819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 410/863] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:10 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:10.777137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:10.777750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:10.783532 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:10.783986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:10.784748 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:10.785183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:10.987191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:10.994881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0b726615-6c5b-450d-bd14-00beb5b9d638 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1518 microversion: 2.1 time: 0.221411 Aug 25 01:33:10.995491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 454/864] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:10 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:11.575189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-edd14f1e-fef2-424a-a037-e7a6c57d33c7 req-61e30c2f-2e97-4d5c-95ab-fefbeb02aac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311b6a44-51eb-49e3-aee1-e24c57a2d392", "tag": "336c249f-6762-4e80-a90d-fd9c1dc12af8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:11.576675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:11.576675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:33:11.583396 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-edd14f1e-fef2-424a-a037-e7a6c57d33c7 req-61e30c2f-2e97-4d5c-95ab-fefbeb02aac7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:11.583918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-edd14f1e-fef2-424a-a037-e7a6c57d33c7 req-61e30c2f-2e97-4d5c-95ab-fefbeb02aac7 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:11.594824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-edd14f1e-fef2-424a-a037-e7a6c57d33c7 req-61e30c2f-2e97-4d5c-95ab-fefbeb02aac7 service nova] Creating event network-changed:336c249f-6762-4e80-a90d-fd9c1dc12af8 for instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 on hv-cinder-79001 Aug 25 01:33:11.599968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-edd14f1e-fef2-424a-a037-e7a6c57d33c7 req-61e30c2f-2e97-4d5c-95ab-fefbeb02aac7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081723 Aug 25 01:33:11.600880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 411/865] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:11.670723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:11.671496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:11.678236 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:11.678707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:11.679563 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:11.680006 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:11.806177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:11.814565 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:11.816431 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:11.817632 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-052ad3f6-161c-47bf-afb9-1f8bb2c48d53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.150880 Aug 25 01:33:11.818425 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 455/866] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:11 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:12.012288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:12.013825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:12.023161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.023623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.024913 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.025348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.154567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:12.163084 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3615dd3e-528d-4ffb-adbc-b4d7d6e3ea75 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1518 microversion: 2.1 time: 0.155172 Aug 25 01:33:12.169275 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 412/867] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:12 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:12.651491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:12.652394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:12.658594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.659071 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.659845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.660272 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.689007 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-91982ed0-9f7e-46e4-89db-58f7b9206ff5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 Aug 25 01:33:12.689554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 456/868] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:33:12 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:12.699109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:12.699599 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:12.706516 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.706986 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.707744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.708173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.736338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1600fd47-1710-4a4c-b3c1-51b0a8a05fa6 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8" status: 200 len: 194 microversion: 2.1 time: 0.040901 Aug 25 01:33:12.736924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 413/869] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Aug 25 01:33:12 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:12.835560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:12.836291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:12.842077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.842813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.843626 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:12.844119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:12.981509 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:12.994476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:12.996364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:12.997999 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cec0e821-22e6-4ef9-b342-47a56b56061f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.166371 Aug 25 01:33:12.998809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 457/870] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:12 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:13.185673 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:13.186199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:13.191897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:13.192336 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:13.193095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:13.193524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:13.313536 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:13.320993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-190d3cc3-140d-44ac-8513-19bd11e8ae11 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.139019 Aug 25 01:33:13.321571 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 414/871] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:13 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:13.381462 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-1f13a26a-7fb2-4543-a1ec-612afbd76a6b req-2d4a0677-83b1-4304-b0b9-a15d77dcdbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "name": "network-vif-plugged", "status": "completed", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:13.383171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:13.383171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:33:13.390837 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-1f13a26a-7fb2-4543-a1ec-612afbd76a6b req-2d4a0677-83b1-4304-b0b9-a15d77dcdbcf service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:13.391329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-1f13a26a-7fb2-4543-a1ec-612afbd76a6b req-2d4a0677-83b1-4304-b0b9-a15d77dcdbcf service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:13.402375 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-1f13a26a-7fb2-4543-a1ec-612afbd76a6b req-2d4a0677-83b1-4304-b0b9-a15d77dcdbcf service nova] Creating event network-vif-plugged:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:33:13.407831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-1f13a26a-7fb2-4543-a1ec-612afbd76a6b req-2d4a0677-83b1-4304-b0b9-a15d77dcdbcf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Aug 25 01:33:13.408662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 458/872] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:14.017560 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:14.018181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:14.023988 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.024445 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.025236 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.025658 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.086644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d326f216-c320-4563-86bc-a0a9608c2815"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:14.087909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:14.094004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.094521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.095317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.095751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.146358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:14.154634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:14.156683 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:14.157818 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-97b10ef7-5ed2-4c90-8a2a-37552a01e074 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.144580 Aug 25 01:33:14.158408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 415/873] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:14 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:33:14.338925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:14.339826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:14.348251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.348715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.349501 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:14.349943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:14.392045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f1648ca6-42ac-4e03-a441-cd2bb9531204 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309323 Aug 25 01:33:14.392753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 459/874] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:33:14 2021] POST /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:33:14.482944 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:14.496635 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fad109ee-31b9-4723-a18d-49842b7f2899 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.161998 Aug 25 01:33:14.497246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 416/875] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:14 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:15.176467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:15.177217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:15.184307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:15.184759 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:15.185529 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:15.185966 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:15.305106 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:15.313811 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:15.315359 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:15.316487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8600401d-8456-4170-a0ef-901ccef27cf8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1806 microversion: 2.20 time: 0.144133 Aug 25 01:33:15.317061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 460/876] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:15 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1806 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:15.514274 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:15.514947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:15.521139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:15.521589 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:15.522361 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:15.522839 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:15.648767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:15.657402 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ffc420b8-576b-41d6-a817-0c176729bb94 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.147013 Aug 25 01:33:15.658118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 417/877] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:15 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:16.334595 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:16.335230 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:16.341010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:16.341446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:16.342197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:16.342624 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:16.657802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:16.666380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:16.667921 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:16.669054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b8ae4ace-648e-4ea6-869e-e30f9a95ce1c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1793 microversion: 2.20 time: 0.338139 Aug 25 01:33:16.669619 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 461/878] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:16 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1793 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:16.675226 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:16.675918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:16.681694 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:16.682216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:16.683127 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:16.683628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:16.799191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:16.806196 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ae10b2e8-9b3e-4065-a8e6-9eb96cebb816 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.135206 Aug 25 01:33:16.806774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 418/879] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:16 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:17.823701 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:17.824250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:17.830511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:17.830990 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:17.831765 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:17.832198 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:17.948718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:17.957207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e3948e84-8836-491e-9fa4-35281029340e tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.137265 Aug 25 01:33:17.957988 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 462/880] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:17 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:18.975300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:18.975912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:18.981669 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:18.982118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:18.982911 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:18.983345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:19.103394 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:19.111125 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d0520a84-a683-4892-aef9-5b5535fad3ca tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.140027 Aug 25 01:33:19.111682 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 419/881] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:18 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:20.127964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:20.128577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:20.134333 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:20.134813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:20.135574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:20.136020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:20.251793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:20.258939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0d6aeeb1-282c-48b9-b317-ecdb5eb953b5 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.135065 Aug 25 01:33:20.259494 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 463/882] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:20 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:21.275760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:21.276366 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:21.284232 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:21.284686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:21.286124 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:21.286569 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:21.403720 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:21.410922 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1c2f8ac6-c5c5-4f84-978c-7b3878dbdfd1 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.138861 Aug 25 01:33:21.411490 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 420/883] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:21 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:21.901125 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:21.902087 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:21.908254 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:21.908693 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:21.909441 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:21.909866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:21.939228 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8be72e96-cdf3-44f2-b773-4b6b0a3c1a12 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041880 Aug 25 01:33:21.939766 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 464/884] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:33:21 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:22.197470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:22.197965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:22.203786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.204240 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.205007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.205440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.233784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-83a3e6a2-4cf9-42b4-a3c8-878703e0d39e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8" status: 200 len: 194 microversion: 2.1 time: 0.040075 Aug 25 01:33:22.235027 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 421/885] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Aug 25 01:33:22 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:33:22.244067 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:22.244556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:22.250318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.250812 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.251584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.252012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.331973 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lazy-loading 'services' on Instance uuid c8b31568-9ffd-49b4-a05e-f336ad399d88 {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:33:22.393997 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6595b48c-deab-4c62-b335-f796c534218d tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8" status: 202 len: 0 microversion: 2.1 time: 0.153442 Aug 25 01:33:22.394566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 465/886] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:33:22 2021] DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d021d88d-6ce7-4cac-a53b-cc2ff6a727c8 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:33:22.428659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:22.429888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:22.436300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.436909 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.437736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:22.438180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:22.570309 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:22.577477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8b8348d9-1ae5-4b4b-9d73-5a73b1ed2583 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.152820 Aug 25 01:33:22.578526 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 422/887] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:22 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:23.594658 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:23.595352 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:23.602610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:23.602610 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:23.603194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:23.603625 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:23.723913 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:23.731172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-557f7b01-a953-47cf-8137-62913a9fccab tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.140744 Aug 25 01:33:23.731729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 466/888] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:23 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:24.567053 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:24.567578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:24.573256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.573703 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.574464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.574927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.602403 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-399954cb-5c1c-4dd6-bc07-f198c18669ce tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d326f216-c320-4563-86bc-a0a9608c2815" status: 200 len: 194 microversion: 2.1 time: 0.039224 Aug 25 01:33:24.602985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 423/889] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Aug 25 01:33:24 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d326f216-c320-4563-86bc-a0a9608c2815 => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:33:24.612850 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:24.613358 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:24.619000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.619531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.620283 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.620707 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.700747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.objects.instance [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lazy-loading 'services' on Instance uuid c8b31568-9ffd-49b4-a05e-f336ad399d88 {{(pid=108271) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:33:24.747712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:24.748328 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:24.754308 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.754865 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.755788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:24.756351 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:24.765339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2750c327-11ef-4293-b3b1-212b61e344aa tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d326f216-c320-4563-86bc-a0a9608c2815" status: 202 len: 0 microversion: 2.1 time: 0.156540 Aug 25 01:33:24.766286 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 467/890] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:33:24 2021] DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments/d326f216-c320-4563-86bc-a0a9608c2815 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:33:24.886662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:24.894329 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9a4a60ee-6f65-4008-ac31-eb14e777358a tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.150210 Aug 25 01:33:24.894900 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 424/891] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:24 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:25.418467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-b069db90-3b93-40f2-a396-3ff28df3ec3b req-8c474b86-8fdf-4cf2-b69a-e255ca102b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "name": "network-vif-plugged", "status": "completed", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:25.420079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:25.420079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:33:25.428172 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b069db90-3b93-40f2-a396-3ff28df3ec3b req-8c474b86-8fdf-4cf2-b69a-e255ca102b1e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:25.429390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b069db90-3b93-40f2-a396-3ff28df3ec3b req-8c474b86-8fdf-4cf2-b69a-e255ca102b1e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:25.440861 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-b069db90-3b93-40f2-a396-3ff28df3ec3b req-8c474b86-8fdf-4cf2-b69a-e255ca102b1e service nova] Creating event network-vif-plugged:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:33:25.446526 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-b069db90-3b93-40f2-a396-3ff28df3ec3b req-8c474b86-8fdf-4cf2-b69a-e255ca102b1e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032019 Aug 25 01:33:25.447533 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 468/892] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:25.911392 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:25.912025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:25.917651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:25.918091 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:25.922902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:25.922902 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:25.934154 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:25.935245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:25.941162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:25.941675 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:25.942492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:25.943024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:25.971108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9cee55f2-8bcc-44c5-8396-9a2ab9100d08 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041026 Aug 25 01:33:25.971772 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 469/893] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:33:25 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 25 01:33:26.041184 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:26.048822 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-922d1e6e-c922-45a2-9615-2a9155b20182 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1574 microversion: 2.1 time: 0.141008 Aug 25 01:33:26.049372 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 425/894] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:25 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:26.080491 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:26.081390 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:26.087015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.087461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.088211 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.088639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.116585 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-699e8742-b976-4e86-8566-9bee52edd79b tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039812 Aug 25 01:33:26.117107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 470/895] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:33:26 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:33:26.176023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:26.176544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:26.182378 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.182851 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.183603 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.184032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.207619 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:33:26.277214 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-14e65ae3-48f8-4ba3-ab5d-b8bcee24aadb tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 204 len: 0 microversion: 2.1 time: 0.105025 Aug 25 01:33:26.277777 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 426/896] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:33:26 2021] DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:33:26.286902 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:26.287515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:26.293235 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.293681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.294435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:26.294905 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:26.412170 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:26.419367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-93bb686a-5f63-4dc6-b8a9-1f9702b64ebd tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1673 microversion: 2.1 time: 0.136101 Aug 25 01:33:26.419928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 471/897] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:26 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1673 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:33:27.066766 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:27.067457 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:27.073193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:27.073634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:27.074382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:27.074840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:27.191997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:27.199152 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-11d077e6-a793-4340-a6ff-c338ff9ee31c tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1561 microversion: 2.1 time: 0.137080 Aug 25 01:33:27.199699 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 427/898] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:27 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1561 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:27.436098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:27.436729 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:27.442475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:27.442952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:27.443703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:27.444129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:27.565106 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:27.572244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0212e7a0-b2dc-4c56-890a-e5c94ae6a962 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1673 microversion: 2.1 time: 0.139809 Aug 25 01:33:27.572798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 472/899] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:27 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1673 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:28.589166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:28.589858 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:28.596172 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:28.596616 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:28.597404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:28.597836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:28.714540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:28.722575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-615ff340-c38f-4872-b9a8-058cd95ca75e tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1673 microversion: 2.1 time: 0.137006 Aug 25 01:33:28.723205 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 428/900] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:28 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1673 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:29.452842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-b7c15453-e70b-436e-a909-48f3d5b59389 req-382b67ba-571f-42f3-bee2-acac6d3a1de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b31568-9ffd-49b4-a05e-f336ad399d88", "name": "network-vif-deleted", "tag": "2b2e8cee-7b57-4858-8548-d09e9e90e699"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:33:29.454702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:33:29.454702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:33:29.461944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b7c15453-e70b-436e-a909-48f3d5b59389 req-382b67ba-571f-42f3-bee2-acac6d3a1de2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:29.462470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-b7c15453-e70b-436e-a909-48f3d5b59389 req-382b67ba-571f-42f3-bee2-acac6d3a1de2 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:29.473776 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-b7c15453-e70b-436e-a909-48f3d5b59389 req-382b67ba-571f-42f3-bee2-acac6d3a1de2 service nova] Creating event network-vif-deleted:2b2e8cee-7b57-4858-8548-d09e9e90e699 for instance c8b31568-9ffd-49b4-a05e-f336ad399d88 on hv-cinder-79001 Aug 25 01:33:29.479401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-b7c15453-e70b-436e-a909-48f3d5b59389 req-382b67ba-571f-42f3-bee2-acac6d3a1de2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030177 Aug 25 01:33:29.480024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 473/901] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:33:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:33:29.740190 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:29.740912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:29.746789 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:29.747245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:29.748005 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:29.748440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:29.777771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:29.778219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:29.778664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lazy-loading 'fault' on Instance uuid c8b31568-9ffd-49b4-a05e-f336ad399d88 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:33:29.817282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e85a2de1c4214589916a2ef12655c5b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b76ebd48c69044859010968bacfba90b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:29.824514 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9cb7b7da-078d-4fde-b9b3-b07e18933894 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 200 len: 1326 microversion: 2.1 time: 0.088085 Aug 25 01:33:29.825078 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 429/902] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:29 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 1326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:30.842310 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:30.842981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:30.849323 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:30.849870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:30.851103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:30.851681 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:30.867026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. Aug 25 01:33:30.867628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:33:30.868513 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-96d98430-fed1-41ed-b4c5-20b0530e713a tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 404 len: 111 microversion: 2.1 time: 0.030715 Aug 25 01:33:30.869038 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 474/903] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:30 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:30.877816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e5c94b2e-61f8-4b5b-ac2c-c6003b5cd7c5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '.version_select at 0x7fd58e2eab80>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:30.901746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e5c94b2e-61f8-4b5b-ac2c-c6003b5cd7c5 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104999948" status: 202 len: 0 microversion: 2.1 time: 0.027764 Aug 25 01:33:30.902578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 430/904] 10.222.0.23 () {58 vars in 1218 bytes} [Wed Aug 25 01:33:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104999948 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:33:33.745189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:33.745674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:33.751976 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:33.752419 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:33.753171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:33.753601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:33.766512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. Aug 25 01:33:33.767050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:33:33.767838 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-172c8199-51cd-4a42-bf77-471647ae5993 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 404 len: 111 microversion: 2.1 time: 0.026289 Aug 25 01:33:33.768335 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 475/905] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:33:33 2021] DELETE /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:33.775845 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:33.776456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: c8b31568-9ffd-49b4-a05e-f336ad399d88] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:33.783093 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:33.783544 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:33.784304 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:33.784736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:33.797571 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. Aug 25 01:33:33.798146 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance c8b31568-9ffd-49b4-a05e-f336ad399d88 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:33:33.798977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4bb9613f-719c-441c-b022-fcff6852fead tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88" status: 404 len: 111 microversion: 2.1 time: 0.026852 Aug 25 01:33:33.799482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 431/906] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:33 2021] GET /compute/v2.1/servers/c8b31568-9ffd-49b4-a05e-f336ad399d88 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:34.927029 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:34.927523 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:34.933451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:34.933895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:34.934651 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:34.935098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:34.948005 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. Aug 25 01:33:34.948573 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:33:34.949362 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-448099a4-ecd6-4df3-9ac9-97b7d6e88854 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 404 len: 111 microversion: 2.1 time: 0.026967 Aug 25 01:33:34.949858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 476/907] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:33:34 2021] DELETE /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:34.957323 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:34.957925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] [instance: 2383f568-887e-4b89-99c4-4dcda46666d0] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:34.963611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:34.964054 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:34.964805 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:34.965229 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:34.978907 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] HTTP exception thrown: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. Aug 25 01:33:34.979477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] Returning 404 to user: Instance 2383f568-887e-4b89-99c4-4dcda46666d0 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:33:34.980268 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-bcaa8266-3f48-447a-b412-058f4ccb1467 tempest-AttachVolumeTestJSON-474577424 tempest-AttachVolumeTestJSON-474577424-project] 10.222.0.23 "GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0" status: 404 len: 111 microversion: 2.1 time: 0.026630 Aug 25 01:33:34.980763 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 432/908] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:33:34 2021] GET /compute/v2.1/servers/2383f568-887e-4b89-99c4-4dcda46666d0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:33:56.957805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:56.958345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:56.964750 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:56.965191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:56.965945 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:56.966363 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:56.993571 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a0068730-0dd8-437d-95e0-b41b30272713 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments/96134619-6e33-4cf4-b250-436df46c4312" status: 200 len: 194 microversion: 2.20 time: 0.039612 Aug 25 01:33:56.994110 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 477/909] 10.222.0.23 () {60 vars in 1454 bytes} [Wed Aug 25 01:33:56 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments/96134619-6e33-4cf4-b250-436df46c4312 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:33:57.059423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:57.059978 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:57.066553 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:57.067115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:57.067881 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:57.068362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:57.149841 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lazy-loading 'services' on Instance uuid 4062759a-7420-4110-8d0c-77cbbc615973 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:33:57.213218 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8ebe29df-4c2e-44a3-adb4-309bf4051c7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments/96134619-6e33-4cf4-b250-436df46c4312" status: 202 len: 0 microversion: 2.20 time: 0.158214 Aug 25 01:33:57.213791 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 433/910] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Aug 25 01:33:57 2021] DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments/96134619-6e33-4cf4-b250-436df46c4312 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:33:57.222126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:57.223065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:57.229164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:57.229916 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:57.230396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:57.231051 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:57.263704 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4938b966-2bfd-4876-ace2-42d931d29a16 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Aug 25 01:33:57.264237 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 478/911] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Aug 25 01:33:57 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 01:33:58.275812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:58.276833 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:58.283381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.283849 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.284627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.285056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.312709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c579b369-0900-4eed-ad4c-31f10b8daeff tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041003 Aug 25 01:33:58.313231 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 434/912] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Aug 25 01:33:58 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:33:58.371917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:58.372406 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:58.378296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.378778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.379547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.380103 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.405186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:33:58.486227 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b88da3c3-a5f7-4fe4-82ab-87d87cced054 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 204 len: 0 microversion: 2.20 time: 0.117904 Aug 25 01:33:58.487166 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 479/913] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Aug 25 01:33:58 2021] DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 01:33:58.496155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:58.496943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:58.503030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.507765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.508731 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:58.509712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:58.642368 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:58.650171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:58.651700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:58.652825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-55493953-5bf5-484f-af17-12ddcb23febf tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.161407 Aug 25 01:33:58.653376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 435/914] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:58 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:33:59.671336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:33:59.672026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:33:59.678426 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:59.678895 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:59.679645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:33:59.680070 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:33:59.801828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:59.809394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:59.810894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:33:59.812014 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9f4e32c7-c54f-4af4-988d-ca9794f00173 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.144713 Aug 25 01:33:59.812559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 480/915] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:33:59 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:00.829061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:00.829668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:00.835449 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:00.835888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:00.836636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:00.837066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:00.955322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:00.962818 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:00.964292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:00.965401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-28f10487-20d6-432c-a996-5e6a2bbee6a6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.140003 Aug 25 01:34:00.965936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 436/916] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:00 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:01.983287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:01.983926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:01.989835 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:01.990312 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:01.991108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:01.991539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:02.107947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:02.116244 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:02.117723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:02.118882 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-315bbc83-3191-438e-92bd-3e7ebc56ec7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 200 len: 1721 microversion: 2.20 time: 0.139342 Aug 25 01:34:02.119472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 481/917] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:01 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:02.596391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-6de41987-8129-4f8c-815c-f166ad43e742 req-a0ebb26c-38c7-480c-afde-6e94f0292a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4062759a-7420-4110-8d0c-77cbbc615973", "name": "network-vif-deleted", "tag": "0bceaf3f-3cb5-457f-a270-6719b1c8af0b"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:02.598030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:34:02.598030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:34:02.605989 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-6de41987-8129-4f8c-815c-f166ad43e742 req-a0ebb26c-38c7-480c-afde-6e94f0292a48 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:02.606434 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-6de41987-8129-4f8c-815c-f166ad43e742 req-a0ebb26c-38c7-480c-afde-6e94f0292a48 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:02.618802 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-6de41987-8129-4f8c-815c-f166ad43e742 req-a0ebb26c-38c7-480c-afde-6e94f0292a48 service nova] Creating event network-vif-deleted:0bceaf3f-3cb5-457f-a270-6719b1c8af0b for instance 4062759a-7420-4110-8d0c-77cbbc615973 on hv-cinder-79001 Aug 25 01:34:02.624285 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-6de41987-8129-4f8c-815c-f166ad43e742 req-a0ebb26c-38c7-480c-afde-6e94f0292a48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 Aug 25 01:34:02.624870 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 437/918] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:34:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:34:03.137423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:03.138016 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:03.144447 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:03.145170 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:03.145853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:03.146329 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:03.161545 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. Aug 25 01:34:03.162133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:34:03.163003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8fe04d98-394d-4161-9bed-c507f72b6285 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 404 len: 111 microversion: 2.20 time: 0.029525 Aug 25 01:34:03.163540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 482/919] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:03 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:34:03.172265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-683bb86a-ceb7-4ab9-aab3-52206b59ff77 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '.version_select at 0x7fd58e332160>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:03.191343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-683bb86a-ceb7-4ab9-aab3-52206b59ff77 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210552620" status: 204 len: 0 microversion: 2.20 time: 0.022936 Aug 25 01:34:03.191901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 438/920] 10.222.0.23 () {60 vars in 1259 bytes} [Wed Aug 25 01:34:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210552620 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 01:34:03.828308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: .version_select at 0x7fd58e6f3ee0>, body: {"keypair": {"name": "tempest-keypair-1536499264"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:03.845961 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:03.849627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:04.044042 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:04.047544 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'key_pairs'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:04.059650 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9f098a4d-94ad-4a86-aa2a-476d321658e8 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.235200 Aug 25 01:34:04.060224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 483/921] 10.222.0.23 () {62 vars in 1199 bytes} [Wed Aug 25 01:34:03 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 25 01:34:05.270608 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2046837663", "imageRef": "78233130-7f49-4a9c-8cb9-e0c6cb26fc32", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b39bbca-d99b-4c6f-89e1-463d16db2dba"}], "security_groups": [{"name": "tempest-securitygroup--1926389675"}], "key_name": "tempest-keypair-1536499264", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:05.361506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.network.neutron [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] validate_networks() for [('4b39bbca-d99b-4c6f-89e1-463d16db2dba', None, None, None, None, None)] {{(pid=108270) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:34:05.802322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Flavor limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:34:05.802798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Image limits 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:34:05.803277 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Flavor pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:34:05.803844 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Image pref 0:0:0 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:34:05.804266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.virt.hardware [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108270) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:34:05.812819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:05.813769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:05.814575 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:05.815038 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:05.831500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:05.835379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Getting quotas for user a8a2c266dd464ce2a957aa7960049b9d and project 0d3f6d9b58da4cf08feb13c48725af79. Resources: {'cores', 'ram', 'instances'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:05.845923 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Going to run 1 instances... {{(pid=108270) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:34:05.848318 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78233130-7f49-4a9c-8cb9-e0c6cb26fc32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108270) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:34:05.893600 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-734ab869-e90e-4fb5-814e-fb95350f235c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.627572 Aug 25 01:34:05.894239 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 439/922] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Aug 25 01:34:05 2021] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 01:34:05.903890 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:05.904499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:05.960184 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:05.968576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:05.970092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:05.971409 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d00950ca-25ee-479a-86b7-92314622a8e0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1282 microversion: 2.20 time: 0.071238 Aug 25 01:34:05.971962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 484/923] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:05 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:06.989178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:06.989782 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:06.996768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:06.997343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:06.998414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:06.998593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:07.056959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:07.065149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:07.066644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:07.067736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7ae776a0-3332-419e-a82b-7e8707019461 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1340 microversion: 2.20 time: 0.082391 Aug 25 01:34:07.068311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 440/924] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:06 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1340 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:08.085662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:08.086311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:08.093338 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:08.093793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:08.094606 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:08.095205 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:08.167590 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-dff1056e-5dab-4239-bb88-0be47b4feecd req-9d7528d6-1870-4414-ba23-9b2462b4042f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:08.169090 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:34:08.169090 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:34:08.181633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-dff1056e-5dab-4239-bb88-0be47b4feecd req-9d7528d6-1870-4414-ba23-9b2462b4042f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:08.182088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-dff1056e-5dab-4239-bb88-0be47b4feecd req-9d7528d6-1870-4414-ba23-9b2462b4042f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:08.213227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-dff1056e-5dab-4239-bb88-0be47b4feecd req-9d7528d6-1870-4414-ba23-9b2462b4042f service nova] Creating event network-changed:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:34:08.218256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-dff1056e-5dab-4239-bb88-0be47b4feecd req-9d7528d6-1870-4414-ba23-9b2462b4042f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054644 Aug 25 01:34:08.219509 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 441/925] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:34:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:34:08.251275 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:08.260421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:08.262142 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:08.263276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e1d31b81-7e74-4445-abc8-3121b5943903 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1408 microversion: 2.20 time: 0.181313 Aug 25 01:34:08.263845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 485/926] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:08 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:09.281444 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:09.282721 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:09.288677 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:09.289128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:09.289884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:09.290318 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:09.407379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:09.414936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:09.416426 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:09.417494 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-365106cb-e8cb-4374-80a9-1862660138e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1408 microversion: 2.20 time: 0.140146 Aug 25 01:34:09.418042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 442/927] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:09 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:10.435197 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:10.435804 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:10.441528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:10.441969 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:10.442749 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:10.443209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:10.574287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:10.582457 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:10.583990 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:10.585086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-20c295cc-48e1-43ed-8446-2530d0376175 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1408 microversion: 2.20 time: 0.153717 Aug 25 01:34:10.585630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 486/928] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:10 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:11.602500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:11.603166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:11.609065 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:11.609521 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:11.610875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:11.611274 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:11.736289 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:11.743993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:11.745572 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:11.746668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e8c3e84a-eb2d-4005-8236-cbdae8256d47 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1408 microversion: 2.20 time: 0.147859 Aug 25 01:34:11.751532 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 443/929] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:11 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:11.916034 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-f2431ce7-6b76-4d84-b571-be31beea8f0f req-817c1b6e-7f77-4d7e-bc72-c8dd31e59fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "name": "network-vif-plugged", "status": "completed", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:11.917592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:34:11.917592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:34:11.927297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-f2431ce7-6b76-4d84-b571-be31beea8f0f req-817c1b6e-7f77-4d7e-bc72-c8dd31e59fb1 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:11.927821 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-f2431ce7-6b76-4d84-b571-be31beea8f0f req-817c1b6e-7f77-4d7e-bc72-c8dd31e59fb1 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:11.940836 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-f2431ce7-6b76-4d84-b571-be31beea8f0f req-817c1b6e-7f77-4d7e-bc72-c8dd31e59fb1 service nova] Creating event network-vif-plugged:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:34:11.946983 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-f2431ce7-6b76-4d84-b571-be31beea8f0f req-817c1b6e-7f77-4d7e-bc72-c8dd31e59fb1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034341 Aug 25 01:34:11.950705 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 487/930] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:34:12.764313 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:12.764943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:12.771136 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:12.771583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:12.772340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:12.772769 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:12.895272 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:12.902918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:12.904526 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:12.905667 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f0b5f2d4-efa6-4fc7-9040-e792591f6c37 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1408 microversion: 2.20 time: 0.145236 Aug 25 01:34:12.910813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 444/931] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:12 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:13.925057 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:13.925763 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:13.932065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:13.932537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:13.933405 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:13.933830 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:14.068034 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:14.075733 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:14.077224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:14.078358 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-62e0104d-0ca7-4d7e-b5a7-5b3f65503e9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1600 microversion: 2.20 time: 0.157419 Aug 25 01:34:14.079493 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 488/932] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:34:13 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:14.096794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:14.097369 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:14.109050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:14.109050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:14.109050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:14.109050 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:14.185386 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4f5f0596-7d18-422a-bda6-3e2da8e105d1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092788 Aug 25 01:34:14.185973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 445/933] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Aug 25 01:34:14 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:34:15.117276 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:15.118781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:15.123819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-fb6ffcf3-e031-4f98-97b9-285430065dea req-df368e87-a587-45de-aa35-0b0a8ffc1c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:15.125370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:15.125530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:34:15.125530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:34:15.126213 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:15.127211 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:15.127809 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:15.132918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-fb6ffcf3-e031-4f98-97b9-285430065dea req-df368e87-a587-45de-aa35-0b0a8ffc1c52 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:15.133528 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-fb6ffcf3-e031-4f98-97b9-285430065dea req-df368e87-a587-45de-aa35-0b0a8ffc1c52 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:15.145879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-fb6ffcf3-e031-4f98-97b9-285430065dea req-df368e87-a587-45de-aa35-0b0a8ffc1c52 service nova] Creating event network-changed:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:34:15.151644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-fb6ffcf3-e031-4f98-97b9-285430065dea req-df368e87-a587-45de-aa35-0b0a8ffc1c52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031305 Aug 25 01:34:15.152966 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 446/934] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:34:15.206594 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7857cf6b-b0ad-4838-895b-0f968575a174 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.092839 Aug 25 01:34:15.207537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 489/935] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:15 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:16.218047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:16.219255 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:16.227004 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:16.227457 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:16.228227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:16.228663 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:16.290935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-763ead63-608a-463f-add2-22aad26cdb02 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.076939 Aug 25 01:34:16.291531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 447/936] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:16 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:17.302242 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:17.303171 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:17.309510 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:17.309955 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:17.310732 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:17.311191 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:17.372853 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5e726449-3480-4474-9081-5202b10a4067 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.074601 Aug 25 01:34:17.373459 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 490/937] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:17 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:18.384266 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:18.385450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:18.392555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:18.392998 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:18.393959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:18.394572 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:18.469799 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e25d5590-22da-40d6-a09b-22ef3f04513a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.088690 Aug 25 01:34:18.470551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 448/938] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:18 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:19.480944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:19.482466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:19.489546 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:19.489993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:19.490789 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:19.491224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:19.549879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ce41761f-8b0d-4cff-9300-c5f82c8915c0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.072748 Aug 25 01:34:19.551147 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 491/939] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:19 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:20.561047 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:20.562056 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:20.568483 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:20.568929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:20.569685 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:20.570113 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:20.626614 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-53e34588-e846-4548-b991-0072c017ade6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.069494 Aug 25 01:34:20.627411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 449/940] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:20 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:21.638159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:21.639180 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:21.646243 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:21.646712 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:21.647480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:21.647915 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:21.704004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5ecc7f7d-2b30-46b1-92bd-0f5dfbbff267 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.070067 Aug 25 01:34:21.704599 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 492/941] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:21 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:22.714467 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:22.715492 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:22.722583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:22.723059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:22.723823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:22.724264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:22.780194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3f78b97d-3519-4674-9890-230548603a00 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.069709 Aug 25 01:34:22.780774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 450/942] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:22 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:23.791732 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:23.792649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:23.799660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:23.800113 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:23.800912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:23.801340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:23.861174 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f46b6fba-0ce8-4ffb-83fc-07e81eea886d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.073399 Aug 25 01:34:23.861943 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 493/943] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:23 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:24.872567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:24.873713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:24.881722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:24.882183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:24.882990 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:24.883428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:24.941801 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a45e3173-5c80-4956-899d-9de817a8cf32 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 14 microversion: 2.20 time: 0.073593 Aug 25 01:34:24.942417 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 451/944] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:24 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:25.952815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:25.954442 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:25.960802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:25.961247 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:25.962012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:25.962449 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:26.034418 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b06bd26d-4845-4aaa-a36c-e62c0ebefe53 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 5108 microversion: 2.20 time: 0.085532 Aug 25 01:34:26.037780 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 494/945] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:25 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 5108 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:34:27.046073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:27.047046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:27.054042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:27.054502 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:27.055322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:27.055750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:27.128707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f916caa0-600e-4c16-94ed-05dd0d22e180 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 15025 microversion: 2.20 time: 0.086653 Aug 25 01:34:27.130089 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 452/946] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:27 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 15025 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:34:28.141261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:28.142381 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:28.149486 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:28.150014 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:28.150888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:28.151419 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:28.226848 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9cc1525d-c227-4f57-a602-a9e696c0a1a7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 18498 microversion: 2.20 time: 0.089830 Aug 25 01:34:28.227783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 495/947] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:28 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 18498 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:29.241302 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:29.243169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:29.251564 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:29.252344 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:29.253473 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:29.255633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:29.337008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4d958076-3881-4488-a5ab-91d5840f9532 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 19342 microversion: 2.20 time: 0.100136 Aug 25 01:34:29.339768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 453/948] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:29 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 19342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:30.350629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:30.351757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:30.358306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:30.358807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:30.359678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:30.360152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:30.439088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5dd1d3cc-c1bf-44aa-a3e9-5ff451a9e114 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 22119 microversion: 2.20 time: 0.092161 Aug 25 01:34:30.440597 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 496/949] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:30 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 22119 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:31.451128 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:31.453384 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:31.460208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:31.460655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:31.461628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:31.462063 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:31.536389 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e0b56ef8-cab3-429d-b8ed-a18066d68d28 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 23601 microversion: 2.20 time: 0.089422 Aug 25 01:34:31.537104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 454/950] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:31 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 23601 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:32.549400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:32.550391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:32.556872 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:32.557112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:32.557907 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:32.559026 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:32.635724 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e7792db8-df69-410d-bdc3-39a79952e056 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 25042 microversion: 2.20 time: 0.090352 Aug 25 01:34:32.637343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 497/951] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:32 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 25042 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:34:33.650278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:33.651281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:33.669707 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:33.675158 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:33.676547 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:33.677166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:33.771678 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d9175f77-e1ec-4756-a5f7-ab7fb510faf0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 26602 microversion: 2.20 time: 0.126078 Aug 25 01:34:33.773439 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 455/952] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:33 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 26602 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:34.783941 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:34.784942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:34.791480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:34.793208 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:34.794194 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:34.794888 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:34.882280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-90ed6ade-16c4-4541-b0c0-0f803c3dac1e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 27631 microversion: 2.20 time: 0.102805 Aug 25 01:34:34.883438 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 498/953] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:34 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 27631 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:35.894640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:35.895683 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:35.902013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:35.902458 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:35.903642 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:35.904249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:35.981049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6ad32929-8a61-4b18-98c7-4bfe17de715f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28114 microversion: 2.20 time: 0.091063 Aug 25 01:34:35.982113 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 456/954] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:35 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28114 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:36.994010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:36.994956 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:37.006022 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:37.006731 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:37.007700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:37.008308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:37.085294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f19c11e9-0e3f-4f49-ba69-3108f7cb7407 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28176 microversion: 2.20 time: 0.095216 Aug 25 01:34:37.086770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 499/955] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:36 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28176 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:38.097503 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:38.099212 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:38.105713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:38.106431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:38.107529 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:38.108133 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:38.203185 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-48e8d8cc-f2e7-4e04-9593-d7162796f994 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28467 microversion: 2.20 time: 0.109795 Aug 25 01:34:38.203811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 457/956] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:38 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:39.215967 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:39.217581 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:39.227263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:39.227706 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:39.228485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:39.228912 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:39.326992 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-278e3855-db1e-4526-95fa-6232553c71c6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28635 microversion: 2.20 time: 0.115288 Aug 25 01:34:39.329700 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 500/957] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:39 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28635 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:40.339466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:40.340620 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:40.347438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:40.348033 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:40.349153 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:40.349809 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:40.417588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6ed5509e-9f80-488b-ad6a-1b4ff1ab31e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28635 microversion: 2.20 time: 0.082031 Aug 25 01:34:40.418593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 458/958] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:40 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:41.429826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:41.430849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:41.439828 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:41.440583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:41.441364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:41.441797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:41.511727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6cef6cd1-d681-43d9-84b8-2e8f97609f31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28635 microversion: 2.20 time: 0.085550 Aug 25 01:34:41.512297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 501/959] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:41 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28635 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:42.524574 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:42.525557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:42.532169 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:42.532617 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:42.533371 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:42.534004 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:42.612310 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b3003c72-2bff-4a7c-a5d0-ead2d1265bf6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 28782 microversion: 2.20 time: 0.091553 Aug 25 01:34:42.616283 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 459/960] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:42 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 28782 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:43.625448 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:43.627263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:43.637320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:43.639274 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:43.640522 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:43.641264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:43.717222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f13d2696-dc37-4ad0-b4c5-3d60a43d9079 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 30928 microversion: 2.20 time: 0.096452 Aug 25 01:34:43.718225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 502/961] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:43 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 30928 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:43.963103 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'create', calling method: .version_select at 0x7fd58dab7ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1889544522"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:43.980874 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for project bd502484c4f842cab183438793976e99. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:43.985197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for user 0b39db8c6d1a4a7591acabe30d1cc60b and project bd502484c4f842cab183438793976e99. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:44.308588 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for project bd502484c4f842cab183438793976e99. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:44.312198 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.quota [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for user 0b39db8c6d1a4a7591acabe30d1cc60b and project bd502484c4f842cab183438793976e99. Resources: {'key_pairs'} {{(pid=108270) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:44.324342 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1f93c628-75d2-4e8b-9123-655dc44ce3cf tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.365286 Aug 25 01:34:44.324926 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 460/962] 10.222.0.23 () {60 vars in 1158 bytes} [Wed Aug 25 01:34:43 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:44.373318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1890020780", "imageRef": "bee18ad2-a721-45f9-b683-dd67cab3328d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1889544522", "networks": [{"uuid": "acc053e6-12a9-4f33-968f-821d031fe3ac"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:44.423196 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] validate_networks() for [('acc053e6-12a9-4f33-968f-821d031fe3ac', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:34:44.729067 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:44.730088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:44.736072 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:44.736530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:44.737290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:44.737725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:44.775992 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:34:44.776467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:34:44.776926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:34:44.777328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:34:44.777764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:34:44.786145 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:44.786584 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:44.787400 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:44.787858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:44.803368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for project bd502484c4f842cab183438793976e99. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:34:44.807202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Getting quotas for user 0b39db8c6d1a4a7591acabe30d1cc60b and project bd502484c4f842cab183438793976e99. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:34:44.809034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ffa39821-e54e-4ab4-a571-f1aeab3795d9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 32851 microversion: 2.20 time: 0.083475 Aug 25 01:34:44.809737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 461/963] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:44 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 32851 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:34:44.818438 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:34:44.820808 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bee18ad2-a721-45f9-b683-dd67cab3328d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:34:44.866474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4334ecd9-0aad-4d7b-8b9c-7b06446385c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497039 Aug 25 01:34:44.867064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 503/964] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:34:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:34:44.877712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-982e81dc-0870-42a0-a2de-e6e37bba76f5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:44.878416 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-982e81dc-0870-42a0-a2de-e6e37bba76f5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:44.932964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-982e81dc-0870-42a0-a2de-e6e37bba76f5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:44.940498 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-982e81dc-0870-42a0-a2de-e6e37bba76f5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1259 microversion: 2.1 time: 0.067254 Aug 25 01:34:44.941079 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 462/965] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:44 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:45.822190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:45.823234 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:45.829764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:45.830205 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:45.831028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:45.831472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:45.910474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-788b178e-0b7e-41ed-96e9-f20ce3f5c8cc tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 33752 microversion: 2.20 time: 0.091925 Aug 25 01:34:45.913854 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 504/966] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:45 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 33752 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:45.958506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:45.959173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:45.966644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:45.967219 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:45.968276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:45.968718 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:46.028526 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:46.037643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-27bad454-cdbf-4319-b73a-e293c72e07a1 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1317 microversion: 2.1 time: 0.084242 Aug 25 01:34:46.038195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 463/967] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:45 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1317 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:46.922557 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:46.923636 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:46.930306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:46.930796 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:46.931576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:46.931995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:47.055564 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:47.056117 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:47.062161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:47.062609 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:47.063649 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:47.064085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:47.196045 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:47.204391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-cc189fe8-a710-487c-a4ff-4dff18802bac tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.152489 Aug 25 01:34:47.205244 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 464/968] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:47 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:48.220567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:48.221225 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:48.227705 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:48.228152 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:48.228917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:48.229357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:48.367134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:48.378210 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-835958cf-0991-496b-8e07-e9630db4fec4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.161225 Aug 25 01:34:48.379140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 465/969] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:48 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:49.395906 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:49.396590 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:49.402886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:49.403329 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:49.404090 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:49.404517 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:49.531654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:49.538947 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-276fdc55-394b-48d7-9251-35149632f79e tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.146683 Aug 25 01:34:49.539500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 466/970] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:49 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:50.556116 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:50.556817 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:50.562993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:50.563438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:50.564495 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:50.565198 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:50.688106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:50.695611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-441e5358-4ef7-4a4c-a744-b3227fbf2529 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.143123 Aug 25 01:34:50.696175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 467/971] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:50 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:51.712755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:51.713431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:51.720032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:51.720427 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:51.721193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:51.721629 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:51.847729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:51.855938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d781a35e-d63b-4477-b5b4-a0cc3129a961 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.146792 Aug 25 01:34:51.856633 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 468/972] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:51 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:52.875019 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:52.875737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:52.882470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:52.882959 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:52.884012 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:52.884453 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:53.004744 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:53.013290 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0858f54b-ac97-4919-99bd-bbdffc481345 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.143737 Aug 25 01:34:53.013879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 469/973] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:52 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:54.032322 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:54.033187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:54.039737 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:54.040267 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:54.041131 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:54.041651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:54.162811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:54.170385 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-70ccbb6f-a55a-46c2-be16-d4f975de6488 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.142631 Aug 25 01:34:54.171724 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 470/974] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:54 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:55.190727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:55.190727 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:55.194977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:55.195437 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:55.196224 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:55.196722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:55.323673 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:55.331806 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fef45837-9244-4b59-8f7f-a3b94c459ec7 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.148021 Aug 25 01:34:55.341458 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 471/975] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:55 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:56.349155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:56.349868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:56.355568 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:56.356020 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:56.356784 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:56.357222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:56.477339 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:56.484464 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9c332271-5af4-4dca-8894-53e2b922f964 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.139139 Aug 25 01:34:56.485028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 472/976] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:56 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:34:57.403640 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e786983f-4925-4974-9b01-babf0ca863f4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 200 len: 38336 microversion: 2.20 time: 10.485580 Aug 25 01:34:57.404673 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 505/977] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:46 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 38336 bytes in 10488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:34:57.414393 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:57.415061 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:57.421752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:57.422235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:57.423049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:57.423490 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:57.446235 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-545b4e81-112a-4234-a8de-034b2491e915 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/ips" status: 200 len: 152 microversion: 2.20 time: 0.035591 Aug 25 01:34:57.446810 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 473/978] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Aug 25 01:34:57 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:34:57.502629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:57.503834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:57.514233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:57.515056 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:57.516297 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:57.517035 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:57.646425 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:57.672019 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-01e355e2-71eb-4bff-8b4c-b172df2f71c5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.174499 Aug 25 01:34:57.682832 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 506/979] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:57 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:57.989927 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-38d9d195-8bb8-4e52-81cf-e3b08b5d4db1 req-8bef3d48-8e75-475e-83d3-925a5361046b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:57.992123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:34:57.992123 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:34:58.000058 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-38d9d195-8bb8-4e52-81cf-e3b08b5d4db1 req-8bef3d48-8e75-475e-83d3-925a5361046b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:58.000582 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-38d9d195-8bb8-4e52-81cf-e3b08b5d4db1 req-8bef3d48-8e75-475e-83d3-925a5361046b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:58.016968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-38d9d195-8bb8-4e52-81cf-e3b08b5d4db1 req-8bef3d48-8e75-475e-83d3-925a5361046b service nova] Creating event network-changed:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:34:58.021681 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-38d9d195-8bb8-4e52-81cf-e3b08b5d4db1 req-8bef3d48-8e75-475e-83d3-925a5361046b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036122 Aug 25 01:34:58.022278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 474/980] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:34:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:34:58.689777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:58.691474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:58.698338 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:58.698806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:58.699757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:58.700186 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:58.888687 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:34:58.897554 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c70ec07c-b9a0-44a9-9efb-cb912bf77f19 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.212066 Aug 25 01:34:58.898130 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 507/981] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:58 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:34:59.644816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:34:59.645409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:59.651404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.651848 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.652604 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.653032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.677436 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lazy-loading 'flavor' on Instance uuid 820736cb-49e0-4cb7-b3da-cf2365ddbc9d {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:34:59.915918 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:59.917090 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:59.923209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.923923 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.924899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.925521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.947592 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-73763262-efbb-46b8-98ca-9d7edce083b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 202 len: 0 microversion: 2.20 time: 0.306664 Aug 25 01:34:59.948531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 475/982] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:34:59 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:34:59.953854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:34:59.954441 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:34:59.966295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.966861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.968246 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:34:59.968704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:34:59.995429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:35:00.086293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-32b730b5-2d45-486b-b25d-072b3acaa101 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "DELETE /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 204 len: 0 microversion: 2.1 time: 0.135741 Aug 25 01:35:00.087088 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 476/983] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:34:59 2021] DELETE /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:35:00.096421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:00.101073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-839cf545-a644-4281-a008-d64959cd6092 req-7b2b399f-9b1c-42e2-937b-b674dc0a9726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:00.102165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:00.102165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:00.105972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c0d158b0-3fcd-46e8-b069-7b3009acc64d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.194712 Aug 25 01:35:00.107467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 508/984] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:34:59 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:00.112410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:00.113013 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:00.118429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-839cf545-a644-4281-a008-d64959cd6092 req-7b2b399f-9b1c-42e2-937b-b674dc0a9726 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:00.119182 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:00.120066 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-839cf545-a644-4281-a008-d64959cd6092 req-7b2b399f-9b1c-42e2-937b-b674dc0a9726 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:00.120513 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:00.121443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:00.122162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:00.133236 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-839cf545-a644-4281-a008-d64959cd6092 req-7b2b399f-9b1c-42e2-937b-b674dc0a9726 service nova] Creating event network-changed:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:35:00.138559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-839cf545-a644-4281-a008-d64959cd6092 req-7b2b399f-9b1c-42e2-937b-b674dc0a9726 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049819 Aug 25 01:35:00.142888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 477/985] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:00.148129 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:00.148840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:00.156535 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:00.156993 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:00.157924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:00.158367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:00.324758 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:00.336875 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:00.339847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:00.341604 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ccde82df-1f5a-4abb-8a68-0f24ec2b10ee tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.232882 Aug 25 01:35:00.342770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 509/986] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:00 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:00.386256 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:00.395684 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a029606b-7487-4b52-972a-d46d93c90ece tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1567 microversion: 2.1 time: 0.251561 Aug 25 01:35:00.406864 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 478/987] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:00 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:01.122344 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:01.122985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:01.129702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.130152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.130947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.131385 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.247152 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:01.254744 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1608d5e0-f4aa-4308-bbc9-728d0373439d tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.136050 Aug 25 01:35:01.255298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 510/988] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:01 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:01.360284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:01.360887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:01.366988 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.367465 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.368242 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.368671 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.415514 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:01.416131 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:01.422550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.423033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.423834 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:01.424268 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:01.521548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:01.529149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:01.530621 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:01.531768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9baa8970-9d82-49a7-9bc5-9749aa518521 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.175158 Aug 25 01:35:01.532312 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 479/989] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:01 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:01.568148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:01.575417 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6a821e3a-5985-479e-95ca-5925d7298d83 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1448 microversion: 2.1 time: 0.163568 Aug 25 01:35:01.575981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 511/990] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:01 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1448 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:02.156402 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-80d46011-6df7-40ea-b296-d7db457ba53e req-f8d2f05e-dd4b-4ee2-a592-c36e128b020f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "name": "network-vif-plugged", "status": "completed", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:02.157897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:02.157897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:02.165013 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-80d46011-6df7-40ea-b296-d7db457ba53e req-f8d2f05e-dd4b-4ee2-a592-c36e128b020f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.165469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-80d46011-6df7-40ea-b296-d7db457ba53e req-f8d2f05e-dd4b-4ee2-a592-c36e128b020f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.178480 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-80d46011-6df7-40ea-b296-d7db457ba53e req-f8d2f05e-dd4b-4ee2-a592-c36e128b020f service nova] Creating event network-vif-plugged:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:35:02.183966 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-80d46011-6df7-40ea-b296-d7db457ba53e req-f8d2f05e-dd4b-4ee2-a592-c36e128b020f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031655 Aug 25 01:35:02.185035 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 480/991] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:02.276119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-89e4ee11-54bf-40bc-82da-1a361f38f524 req-b27abfcc-05fa-43fa-b93e-13c3d6f0082e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534244b4-6d9f-4918-b1e1-3ea057e19cbf", "name": "network-vif-deleted", "tag": "a3775475-a3b7-4d85-a6f7-89a52ab37abe"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:02.277190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:02.277910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:02.278376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:02.278376 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:02.287358 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.288113 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.289120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.289664 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.289941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-89e4ee11-54bf-40bc-82da-1a361f38f524 req-b27abfcc-05fa-43fa-b93e-13c3d6f0082e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.290418 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-89e4ee11-54bf-40bc-82da-1a361f38f524 req-b27abfcc-05fa-43fa-b93e-13c3d6f0082e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.303303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-89e4ee11-54bf-40bc-82da-1a361f38f524 req-b27abfcc-05fa-43fa-b93e-13c3d6f0082e service nova] Creating event network-vif-deleted:a3775475-a3b7-4d85-a6f7-89a52ab37abe for instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf on hv-cinder-79001 Aug 25 01:35:02.308729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-89e4ee11-54bf-40bc-82da-1a361f38f524 req-b27abfcc-05fa-43fa-b93e-13c3d6f0082e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037254 Aug 25 01:35:02.309630 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 481/992] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:02.414211 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:02.421419 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6b677f4e-083e-4f94-accd-2fd0a7121ba4 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.153675 Aug 25 01:35:02.421979 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 512/993] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:02 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:02.550331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:02.551051 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:02.557995 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.558581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.559425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.559860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.592463 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:02.593072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:02.600422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.601088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.601871 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:02.602310 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:02.698711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c9651dc204465eb9038c903a08910f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf67756f57948e9a1bcaae4578b8fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:02.709613 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f80b59e2-72b3-4f50-b4c1-80e60c9bbf71 tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 200 len: 1218 microversion: 2.1 time: 0.120767 Aug 25 01:35:02.710203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 513/994] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:02 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:02.721767 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:02.730403 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:02.731956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:02.733120 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6071fef3-6849-4e56-9504-df6b5eff4c9b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.186822 Aug 25 01:35:02.733672 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 482/995] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:02 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:03.437841 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:03.438465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:03.444504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.444952 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.445716 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.446147 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.564086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:03.571423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ab71d69a-b353-490b-8e15-1a28f4bb38eb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1359 microversion: 2.1 time: 0.137409 Aug 25 01:35:03.571984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 514/996] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:03 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:03.725583 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:03.726145 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] [instance: 534244b4-6d9f-4918-b1e1-3ea057e19cbf] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:03.731811 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.732260 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.733016 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.733450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.746025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] HTTP exception thrown: Instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf could not be found. Aug 25 01:35:03.746602 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Returning 404 to user: Instance 534244b4-6d9f-4918-b1e1-3ea057e19cbf could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:35:03.747433 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-369a71f1-8a53-405c-ad86-b1739b1badec tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf" status: 404 len: 111 microversion: 2.1 time: 0.025583 Aug 25 01:35:03.747936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 483/997] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:03 2021] GET /compute/v2.1/servers/534244b4-6d9f-4918-b1e1-3ea057e19cbf => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:35:03.754954 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:03.755701 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:03.762403 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.762889 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.763666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:03.764585 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:03.882500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:03.891905 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:03.893694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:03.895193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-1d641d36-0127-48fa-9be6-e57b7a41abc1 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.146866 Aug 25 01:35:03.895993 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 515/998] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:03 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:03.909357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cf2c0fbc-eebc-49e6-8e24-6058f701f83f tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] Calling method '.version_select at 0x7fd58e3329d0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:03.927786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-cf2c0fbc-eebc-49e6-8e24-6058f701f83f tempest-TestShelveInstance-583054876 tempest-TestShelveInstance-583054876-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-225380796" status: 202 len: 0 microversion: 2.1 time: 0.022026 Aug 25 01:35:03.928356 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 484/999] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:35:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-225380796 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:35:04.588299 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:04.588907 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:04.594709 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.595155 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:04.595907 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.596331 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:04.770586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:04.777787 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d433d7ee-42ab-434c-9c5b-e3785d041d89 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1549 microversion: 2.1 time: 0.193102 Aug 25 01:35:04.778350 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 516/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:04 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:04.793931 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:04.794625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:04.801042 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.801559 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:04.802389 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.802929 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:04.913241 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:04.913830 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:04.922157 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.922602 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:04.923395 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:04.923823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:05.227409 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.234539 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-983858ad-2afe-4077-b0b9-feaebfe5a535 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1549 microversion: 2.1 time: 0.444299 Aug 25 01:35:05.235108 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 485/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:04 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1549 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:05.249373 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:05.252729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:05.252729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:05.253722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.254450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Searching by: {'deleted': False, 'project_id': 'bd502484c4f842cab183438793976e99'} {{(pid=108270) get_all /opt/stack/nova/nova/compute/api.py:2867}} Aug 25 01:35:05.261141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:05.261584 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:05.262367 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:05.262819 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:05.332201 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.340314 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.341816 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.343678 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8fb1b16a-601a-4517-b44d-c367a40d8b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.434056 Aug 25 01:35:05.354159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 517/1002] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:04 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:05.354618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.multi_cell_list [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108270) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 25 01:35:05.449573 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-030a786b-de58-4cae-82b0-23ca5f0df29c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203364 Aug 25 01:35:05.450184 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 486/1003] 10.222.0.23 () {58 vars in 1125 bytes} [Wed Aug 25 01:35:05 2021] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:35:05.460674 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:05.461289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:05.467792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:05.468534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:05.469326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:05.469755 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:05.708793 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:05.715914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b45eaee1-3394-4b55-b825-a763c5c7912c tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1549 microversion: 2.1 time: 0.258976 Aug 25 01:35:05.716469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 518/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:05 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:06.362046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:06.362967 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:06.369383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:06.369937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:06.370878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:06.371550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:06.514522 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:06.526761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:06.528482 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:06.530387 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e2f4a862-db4a-467f-a4a3-bb161f4e418f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.172328 Aug 25 01:35:06.539245 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 487/1005] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:06 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:07.273311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90af8fc7-e925-4afb-828f-af8e4c2b3fce"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:07.275659 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:07.280769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:07.281213 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:07.281977 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:07.282401 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:07.548875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:07.549428 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:07.555577 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:07.556079 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:07.557055 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:07.557490 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:07.595866 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-498a3681-8b6f-4f38-8623-27e4bd9b9959 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326096 Aug 25 01:35:07.596498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 519/1006] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Aug 25 01:35:07 2021] POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:07.791736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:07.800216 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:07.801668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:07.802825 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-42b34d0f-2917-47b1-ae95-de27181fa94e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.258192 Aug 25 01:35:07.803379 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 488/1007] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:07 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:08.821868 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:08.822586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:08.829084 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:08.829535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:08.830300 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:08.830756 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:09.084568 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:09.094588 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:09.096391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:09.097581 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-530059e6-6605-4065-b755-3337881bef75 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.280389 Aug 25 01:35:09.098132 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 520/1008] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:08 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:10.115491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:10.116106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:10.122200 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:10.124638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:10.125621 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:10.126238 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:10.246509 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:10.254574 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:10.256078 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:10.257199 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e56864cb-30d7-4f61-b1cd-3a689a5b1fc9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.145320 Aug 25 01:35:10.257746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 489/1009] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:10 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:11.276280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:11.276981 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:11.283741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:11.284264 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:11.285100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:11.285601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:11.405045 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:11.412721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:11.414214 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:11.415376 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-57ae6a10-6096-43dd-8f92-13a3faf939d0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1746 microversion: 2.20 time: 0.142741 Aug 25 01:35:11.415940 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 521/1010] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:11 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1746 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:12.433188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:12.433743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:12.439545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:12.439988 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:12.440761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:12.441194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:12.572699 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:12.580921 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:12.582411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:12.583557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3e18f05c-fdef-4e59-acb8-6cc7f576ce9c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.154227 Aug 25 01:35:12.584651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 490/1011] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:12 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:13.604052 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:13.606047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:13.613334 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:13.613814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:13.614586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:13.615041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:13.785337 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:13.801256 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:13.803778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:13.805482 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f69c108e-0b47-462f-9bba-9305b80fe3e7 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.206354 Aug 25 01:35:13.819511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 522/1012] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:13 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:14.213726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:14.215034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:14.222561 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:14.223259 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:14.224491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:14.225121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:14.294457 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-e1f0a53a-ec9e-4e89-9d66-328c3fd78dcc req-05169b0f-c5d8-4432-88af-75a07b292e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "name": "network-vif-plugged", "status": "completed", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:14.296899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:14.296899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:14.316596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-e1f0a53a-ec9e-4e89-9d66-328c3fd78dcc req-05169b0f-c5d8-4432-88af-75a07b292e74 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:14.317195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-e1f0a53a-ec9e-4e89-9d66-328c3fd78dcc req-05169b0f-c5d8-4432-88af-75a07b292e74 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:14.343499 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-e1f0a53a-ec9e-4e89-9d66-328c3fd78dcc req-05169b0f-c5d8-4432-88af-75a07b292e74 service nova] Creating event network-vif-plugged:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:35:14.349919 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-e1f0a53a-ec9e-4e89-9d66-328c3fd78dcc req-05169b0f-c5d8-4432-88af-75a07b292e74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058805 Aug 25 01:35:14.351115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 523/1013] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:35:14.363917 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:14.375332 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-3475f36c-e6a3-44d6-9328-442286c3333a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1595 microversion: 2.1 time: 0.165852 Aug 25 01:35:14.376008 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 491/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:14 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1595 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:14.831061 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:14.832412 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:14.839351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:14.840043 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:14.841024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:14.841665 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:15.045483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:15.053224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:15.054894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:15.056047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e989f920-2f99-4f0e-b519-013808ce6de9 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.231997 Aug 25 01:35:15.056844 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 524/1015] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:14 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:16.077106 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:16.077785 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:16.083810 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:16.085249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:16.086264 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:16.087493 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:16.242011 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:16.251398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:16.253288 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:16.254788 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5611ff90-4980-4a49-aadd-b0e9f318c8d2 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.184205 Aug 25 01:35:16.267126 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 492/1016] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:16 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:16.422422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-9a7fc829-e44d-4fd3-b593-d2adf5d1a0d9 req-b5ff9f8d-5ac4-4f57-a4b4-338b37762de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:16.424079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:16.424079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:16.438792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-9a7fc829-e44d-4fd3-b593-d2adf5d1a0d9 req-b5ff9f8d-5ac4-4f57-a4b4-338b37762de9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:16.439669 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-9a7fc829-e44d-4fd3-b593-d2adf5d1a0d9 req-b5ff9f8d-5ac4-4f57-a4b4-338b37762de9 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:16.455380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-9a7fc829-e44d-4fd3-b593-d2adf5d1a0d9 req-b5ff9f8d-5ac4-4f57-a4b4-338b37762de9 service nova] Creating event network-changed:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:35:16.462650 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-9a7fc829-e44d-4fd3-b593-d2adf5d1a0d9 req-b5ff9f8d-5ac4-4f57-a4b4-338b37762de9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043638 Aug 25 01:35:16.468102 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 525/1017] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:17.273945 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:17.276094 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:17.284431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:17.285282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:17.286293 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:17.287099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:17.475046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:17.485471 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:17.487263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:17.488675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7e959e14-1c2d-4dec-baa0-21f8843337b4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.218990 Aug 25 01:35:17.489455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 493/1018] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:17 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:17.720659 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-620304675"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:17.722062 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:17.729950 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:17.731422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:17.732892 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:17.733556 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:17.894924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.network.security_group_api [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Adding security group 2ef5458f-e27e-4a5e-98f6-42612c586ccb to port fe36350f-e1e6-4353-a67f-60cd29711bb6 Aug 25 01:35:18.346399 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-914a156c-d225-4fd6-aa91-305f060e1dff tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action" status: 202 len: 0 microversion: 2.1 time: 0.630227 Aug 25 01:35:18.347810 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 526/1019] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:35:17 2021] POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:35:18.359274 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:18.359885 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:18.367037 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-ade9f4a1-7793-439a-afd7-b4ef8ba29c40 req-b23e8d2f-d5dd-4e6a-b67e-64c5d7b7d554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:18.370909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:18.370909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:18.376519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.377421 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.378765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.379384 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.392483 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-ade9f4a1-7793-439a-afd7-b4ef8ba29c40 req-b23e8d2f-d5dd-4e6a-b67e-64c5d7b7d554 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.392928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-ade9f4a1-7793-439a-afd7-b4ef8ba29c40 req-b23e8d2f-d5dd-4e6a-b67e-64c5d7b7d554 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.421944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-ade9f4a1-7793-439a-afd7-b4ef8ba29c40 req-b23e8d2f-d5dd-4e6a-b67e-64c5d7b7d554 service nova] Creating event network-changed:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:35:18.428394 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-ade9f4a1-7793-439a-afd7-b4ef8ba29c40 req-b23e8d2f-d5dd-4e6a-b67e-64c5d7b7d554 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071635 Aug 25 01:35:18.428994 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 527/1020] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:18.508673 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:18.509423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:18.522187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.523777 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.524596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.525031 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.595964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:18.606873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-178f3a93-8c24-4f25-8edd-69bcafbce73f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1759 microversion: 2.1 time: 0.254667 Aug 25 01:35:18.619340 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 494/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:18 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1759 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:18.689479 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:18.689960 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:18.700581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.705963 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.709823 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.710462 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.723576 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:18.732937 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:18.734652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:18.736030 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f5bb6b2d-3afb-4959-8420-6f71a19fde31 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.231970 Aug 25 01:35:18.746995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 528/1022] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:18 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:18.748668 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:35:18.879178 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b250ffb0-13d6-4123-b721-fddc15c9b8e6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 204 len: 0 microversion: 2.1 time: 0.193932 Aug 25 01:35:18.880374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 495/1023] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:35:18 2021] DELETE /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:35:18.888108 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:18.889077 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:18.896649 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.897564 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:18.898836 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:18.899504 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:19.099020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:19.106471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-603840eb-22c4-4744-bde8-7f9f2ae48c3b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1577 microversion: 2.1 time: 0.222183 Aug 25 01:35:19.109781 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 529/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:18 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:19.753612 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:19.755046 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:19.761882 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:19.762265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:19.763049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:19.764121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:19.900550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:19.908863 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:19.910942 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:19.912282 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8cc45283-aa45-47c3-9a46-2bcc8189d99d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.162754 Aug 25 01:35:19.913359 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 496/1025] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:19 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:20.125974 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:20.126524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:20.132886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:20.133326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:20.134080 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:20.134505 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:20.262703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:20.270207 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fbd614dd-284c-40f8-837b-920b42269b7d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1577 microversion: 2.1 time: 0.148537 Aug 25 01:35:20.280461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 530/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:20 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:20.931454 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:20.932057 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:20.942217 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:20.943044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:20.944033 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:20.946618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:21.099933 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:21.108517 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:21.111164 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:21.112423 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-437ebbff-838f-44de-8426-ce475f3b2b99 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.184703 Aug 25 01:35:21.113085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 497/1027] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:20 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:21.287435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:21.288039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:21.294782 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:21.295238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:21.296036 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:21.296469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:21.368099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:21.380880 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-12526952-c5fe-42b6-9035-63dd7edb3842 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1509 microversion: 2.1 time: 0.097051 Aug 25 01:35:21.381870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 531/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:21 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1509 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:21.839826 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-9fc57ab4-ddee-487b-9665-d4642497f3ba req-33072ffc-0687-470b-92f6-7606ffed9499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311b6a44-51eb-49e3-aee1-e24c57a2d392", "name": "network-vif-deleted", "tag": "336c249f-6762-4e80-a90d-fd9c1dc12af8"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:21.845320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:21.845320 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:21.855712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9fc57ab4-ddee-487b-9665-d4642497f3ba req-33072ffc-0687-470b-92f6-7606ffed9499 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:21.856155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-9fc57ab4-ddee-487b-9665-d4642497f3ba req-33072ffc-0687-470b-92f6-7606ffed9499 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:21.870317 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-9fc57ab4-ddee-487b-9665-d4642497f3ba req-33072ffc-0687-470b-92f6-7606ffed9499 service nova] Creating event network-vif-deleted:336c249f-6762-4e80-a90d-fd9c1dc12af8 for instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 on hv-cinder-79001 Aug 25 01:35:21.880441 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-9fc57ab4-ddee-487b-9665-d4642497f3ba req-33072ffc-0687-470b-92f6-7606ffed9499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044939 Aug 25 01:35:21.881430 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 498/1029] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:22.139965 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:22.141458 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:22.149614 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:22.150695 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:22.152187 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:22.152898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:22.308944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:22.317823 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:22.319601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:22.321055 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-43062f5e-7003-413e-9bd5-24fc6f5c96af tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1741 microversion: 2.20 time: 0.189029 Aug 25 01:35:22.321815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 532/1030] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:22 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:22.399257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:22.399987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:22.406623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:22.407099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:22.407869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:22.408361 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:22.440803 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:22.441354 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:22.441877 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lazy-loading 'fault' on Instance uuid 311b6a44-51eb-49e3-aee1-e24c57a2d392 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:35:22.487812 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:22.495712 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a4475179-ae8c-4449-9090-1b83faaf3187 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 200 len: 1231 microversion: 2.1 time: 0.100589 Aug 25 01:35:22.497017 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 499/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:22 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:23.339549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:23.340159 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:23.347280 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:23.347730 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:23.348488 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:23.348910 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:23.467956 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:23.475446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:23.476924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:23.478040 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-efa6222c-98e5-4178-a284-21a7ae9309d4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1723 microversion: 2.20 time: 0.142497 Aug 25 01:35:23.478614 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 533/1032] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:23 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:23.512098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:23.512736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:23.518580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:23.519073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:23.519837 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:23.520271 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:23.533343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] HTTP exception thrown: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. Aug 25 01:35:23.533918 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Returning 404 to user: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:35:23.534789 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4a82373a-8c22-4b15-9705-1dde5d55a3bd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 404 len: 111 microversion: 2.1 time: 0.026637 Aug 25 01:35:23.535297 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 500/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:23 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:35:23.624887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-395444738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1574037462", "security_groups": [{"name": "tempest-secgroup-smoke-1998696762"}], "block_device_mapping_v2": [{"uuid": "039e3150-5ac8-4fa4-9134-5d105d8bf1ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "109ccc69-61fe-42e8-83da-81c7da1807b8"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:23.722662 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] validate_networks() for [('109ccc69-61fe-42e8-83da-81c7da1807b8', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:35:24.074122 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:35:24.074539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:35:24.075039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:35:24.075471 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:35:24.076422 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:35:24.084764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:24.085202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:24.085986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:24.086416 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:24.103295 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:35:24.107079 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for user 2fba46fcf5a742d28b39d9fef9c91df5 and project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:35:24.165808 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:35:24.167995 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='039e3150-5ac8-4fa4-9134-5d105d8bf1ee',volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:35:24.287797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b105dff8-a886-4d59-8a8b-60dcee9f6e69 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.666555 Aug 25 01:35:24.288592 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 534/1034] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:35:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 01:35:24.298045 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6b1d96ee-6b21-4904-988e-60161a812ff0 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:24.298711 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6b1d96ee-6b21-4904-988e-60161a812ff0 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:24.349007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6b1d96ee-6b21-4904-988e-60161a812ff0 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:24.355425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6b1d96ee-6b21-4904-988e-60161a812ff0 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1094 microversion: 2.1 time: 0.061006 Aug 25 01:35:24.355967 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 501/1035] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:24 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1094 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:24.496677 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:24.497313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:24.504149 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:24.504870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:24.505410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:24.506066 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:24.630333 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:24.639303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:24.640811 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:24.641944 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2cd5eaea-7c8b-4dc8-b810-df36da1ce32e tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1723 microversion: 2.20 time: 0.148998 Aug 25 01:35:24.642496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 535/1036] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:24 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:25.371204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:25.371813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:25.379095 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.379548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:25.380312 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.380743 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:25.452059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:25.460300 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-1dfd228b-e92a-4a5f-89c1-36acfd5e4101 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1210 microversion: 2.1 time: 0.092653 Aug 25 01:35:25.461435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 502/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:25 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:25.660349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:25.660986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:25.667664 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.668320 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:25.669092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.669686 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:25.796950 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:25.805267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:25.806815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:25.807964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-eff366d6-e4c9-484e-aec1-f0e656c03512 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1666 microversion: 2.20 time: 0.151248 Aug 25 01:35:25.808524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 536/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:25 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:25.826406 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3d6350c-5417-492b-a71b-2a0e1658b454"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:25.827478 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:25.833098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.833540 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:25.834294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:25.834840 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.120431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-57c642d2-1581-4c20-a856-7a752f03d833 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298130 Aug 25 01:35:26.121140 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 503/1039] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Aug 25 01:35:25 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 01:35:26.256715 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-57f7c31d-ca80-4d46-94e1-b95ec5f42b87 req-dea43ea1-82ad-4d2d-a6be-2174351ec4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "name": "network-vif-unplugged", "status": "completed", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:26.258599 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:26.258599 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:26.267953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-57f7c31d-ca80-4d46-94e1-b95ec5f42b87 req-dea43ea1-82ad-4d2d-a6be-2174351ec4c8 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.279107 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-57f7c31d-ca80-4d46-94e1-b95ec5f42b87 req-dea43ea1-82ad-4d2d-a6be-2174351ec4c8 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.285292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:26.286097 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:26.295509 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.297025 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.298524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.299722 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.307259 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.compute.server_external_events [req-57f7c31d-ca80-4d46-94e1-b95ec5f42b87 req-dea43ea1-82ad-4d2d-a6be-2174351ec4c8 service nova] Unable to find a host for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d. Dropping event network-vif-unplugged {{(pid=108271) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 25 01:35:26.313572 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-57f7c31d-ca80-4d46-94e1-b95ec5f42b87 req-dea43ea1-82ad-4d2d-a6be-2174351ec4c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056660 Aug 25 01:35:26.314233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 537/1040] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 01:35:26.477010 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:26.477628 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:26.491148 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.491876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.492672 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.493119 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.561965 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-069ca37e-f3b0-4dc5-af80-12d67fee9fa4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments/c3d6350c-5417-492b-a71b-2a0e1658b454" status: 202 len: 0 microversion: 2.20 time: 0.281025 Aug 25 01:35:26.562973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 504/1041] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Aug 25 01:35:26 2021] DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments/c3d6350c-5417-492b-a71b-2a0e1658b454 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 01:35:26.625726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:26.626650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:26.633555 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.634373 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.635777 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.636420 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.641238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:26.648605 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d9419b8c-50e7-4f47-861e-361b417a039e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.175228 Aug 25 01:35:26.649164 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 538/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:26 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:26.714165 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-fcd4a899-db1d-41dc-a637-a9849c16c193 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action" status: 202 len: 0 microversion: 2.20 time: 0.093112 Aug 25 01:35:26.714998 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 505/1043] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Aug 25 01:35:26 2021] POST /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 01:35:26.723233 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:26.724407 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:26.731856 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.733183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.734183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:26.735109 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:26.900139 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:26.910444 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:26.912724 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:26.914456 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-840f5f3e-bc34-46fd-9d6a-ac8aca6a9425 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1674 microversion: 2.20 time: 0.194779 Aug 25 01:35:26.916398 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 539/1044] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:26 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:27.005597 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-67d9050f-11ae-407b-8b23-823b9abd47df req-5775105c-bb2c-46f1-8ba4-8bbe60f89131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf42ba6b-d50a-40e1-9125-f726ddb5be2a", "tag": "7cbfb58b-250b-434a-a8f8-a66c796334e4"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:27.007771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:27.007771 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:35:27.026179 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-67d9050f-11ae-407b-8b23-823b9abd47df req-5775105c-bb2c-46f1-8ba4-8bbe60f89131 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:27.026627 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-67d9050f-11ae-407b-8b23-823b9abd47df req-5775105c-bb2c-46f1-8ba4-8bbe60f89131 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:27.043994 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-67d9050f-11ae-407b-8b23-823b9abd47df req-5775105c-bb2c-46f1-8ba4-8bbe60f89131 service nova] Creating event network-changed:7cbfb58b-250b-434a-a8f8-a66c796334e4 for instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a on hv-cinder-79001 Aug 25 01:35:27.049336 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-67d9050f-11ae-407b-8b23-823b9abd47df req-5775105c-bb2c-46f1-8ba4-8bbe60f89131 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052243 Aug 25 01:35:27.050343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 506/1045] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:27.665818 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:27.666472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:27.674088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:27.674539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:27.675465 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:27.675886 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:27.802047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:27.809318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c9b0a27d-5dd2-4729-a203-b3b8dd9dec27 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.147865 Aug 25 01:35:27.810529 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 540/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:27 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:27.933621 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:27.934314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:27.941125 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:27.941878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:27.943228 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:27.944049 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:28.070052 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:28.077862 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:28.079399 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:28.080538 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-80d0fce7-88e7-4800-a446-8a230cd5eeb5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.150954 Aug 25 01:35:28.081098 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 507/1047] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:27 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:28.826646 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:28.827248 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:28.832867 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:28.833311 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:28.834062 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:28.834487 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:28.960365 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:28.968741 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8842aa6e-6df0-42ca-a693-a3525e6c9181 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.146337 Aug 25 01:35:28.969306 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 541/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:28 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:29.099009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:29.099623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:29.105641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:29.106091 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:29.106888 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:29.107324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:29.243011 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:29.251781 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:29.253595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:29.254946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ef27884d-db1a-40a9-bddf-54ddddcfbac0 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.159577 Aug 25 01:35:29.255957 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 508/1049] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:29 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:29.985313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:29.986037 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:29.992360 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:29.992815 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:29.993936 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:29.994515 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:30.116140 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:30.123779 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-de68c767-8886-41ea-97e3-7bd446328e65 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.142179 Aug 25 01:35:30.124345 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 542/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:29 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:30.273039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:30.273638 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:30.292461 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:30.292938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:30.293764 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:30.294306 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:30.424446 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:30.432655 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:30.434233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:30.435904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b985ed2c-4db8-4cc6-b6a7-84df061b1229 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.166518 Aug 25 01:35:30.436462 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 509/1051] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:30 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:31.140503 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:31.141372 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:31.147696 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:31.148269 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:31.149112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:31.149798 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:31.273655 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:31.281884 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-886fcb56-e795-45c7-9c4b-17b0950a903e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.145035 Aug 25 01:35:31.282500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 543/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:31 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:31.453656 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:31.454284 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:31.460136 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:31.460581 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:31.461331 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:31.461760 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:31.601171 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:31.612847 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:31.614522 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:31.615728 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9c1ee53e-3ece-427e-9a08-ac86eb46455c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.166201 Aug 25 01:35:31.616672 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 510/1053] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:31 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:32.298881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:32.299475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:32.305550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:32.306114 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:32.306975 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:32.307475 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:32.434141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:32.442287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-0bd97ebd-c91b-4ab8-97b8-07e3355d17e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.147156 Aug 25 01:35:32.442887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 544/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:32 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:32.636159 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:32.636758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:32.642669 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:32.643141 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:32.643931 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:32.644362 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:32.769209 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:32.777623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:32.779746 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:32.780873 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-571fdb78-8cbd-4508-a9cf-492da51e6d8a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.148638 Aug 25 01:35:32.781470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 511/1055] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:32 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:33.459642 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:33.460313 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:33.466137 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:33.466577 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:33.467374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:33.467797 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:33.589473 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:33.596887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-01c75f9f-d0df-400b-8f3b-42ef8582e61e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.140831 Aug 25 01:35:33.597461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 545/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:33 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:33.799441 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:33.800102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:33.805649 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:33.806104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:33.806896 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:33.807324 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:33.932593 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:33.941068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:33.942557 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:33.943916 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d56314e3-cf49-4ea4-ac96-6b3139735b4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.148230 Aug 25 01:35:33.944341 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 512/1057] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:33 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:34.613397 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:34.614072 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:34.619986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:34.620426 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:34.621189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:34.621614 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:34.742698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:34.751078 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c4a878bb-9f9e-4cd0-a0ab-41e50c46670c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.141363 Aug 25 01:35:34.751645 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 546/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:34 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:34.962101 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:34.962729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:34.969167 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:34.969618 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:34.970391 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:34.970861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:35.095028 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:35.102843 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:35.104448 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:35.105644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-0686b308-3a6f-45fc-8df6-937444b73b7c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.147291 Aug 25 01:35:35.106189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 513/1059] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:34 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:35.769047 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:35.770587 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:35.777012 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:35.777602 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:35.778507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:35.779288 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:35.910549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:35.917939 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ad3ab0e2-18f5-49dd-86ba-fc2fdb9c02b2 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.152867 Aug 25 01:35:35.921827 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 547/1060] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:35 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:36.125237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:36.125828 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:36.131700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:36.132149 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:36.132908 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:36.133334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:36.256456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:36.264515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:36.266014 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:36.267189 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-b885f635-d053-4705-a869-f5ceddc5fe18 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.146693 Aug 25 01:35:36.267735 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 514/1061] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:36 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:36.934336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:36.935014 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:36.940899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:36.941346 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:36.942106 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:36.942530 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:37.063389 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:37.071425 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f0b3e260-4249-4f49-874f-885039b07715 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.140627 Aug 25 01:35:37.072003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 548/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:36 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:37.285815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:37.286407 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:37.292414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:37.292880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:37.293651 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:37.294732 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:37.426887 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:37.435038 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:37.437156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:37.438401 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6bf500c9-fe15-4f83-8122-0c5d5e1b061a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.156673 Aug 25 01:35:37.439104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 515/1063] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:37 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:38.088702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:38.089410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:38.096062 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:38.096516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:38.097291 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:38.097732 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:38.221964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:38.229410 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-a3f64510-2f39-4270-8977-c4ed996baedd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.144459 Aug 25 01:35:38.229972 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 549/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:38 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:38.456443 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:38.457152 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:38.463456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:38.464181 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:38.465251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:38.465852 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:38.590861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:38.599512 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:38.601001 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:38.602195 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5616bbd8-c739-42d8-b7d8-ba6d7e1af0a5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.149513 Aug 25 01:35:38.602815 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 516/1065] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:38 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:39.246609 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:39.247352 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:39.253112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:39.253558 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:39.254318 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:39.254814 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:39.378893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:39.386521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2aaff395-36f6-4c08-a362-f242ef134378 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.143572 Aug 25 01:35:39.387126 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 550/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:39 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:39.619726 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:39.620462 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:39.627233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:39.627775 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:39.628554 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:39.628995 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:39.746706 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:39.754436 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:39.755977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:39.757119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-342681fd-2642-4efc-8ce9-f48d7b21b31c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.141114 Aug 25 01:35:39.757674 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 517/1067] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:39 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:40.403364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:40.404451 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:40.410374 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:40.410862 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:40.411620 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:40.412049 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:40.527938 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:40.535586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8530b618-e676-439a-809d-8b316156204c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.135896 Aug 25 01:35:40.536144 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 551/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:40 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:40.774390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:40.775030 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:40.781349 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:40.781798 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:40.782556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:40.783032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:40.900987 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:40.909263 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:40.910792 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:40.911923 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e3c5f994-3dc3-423c-84ef-8847cc85a02c tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.141215 Aug 25 01:35:40.912479 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 518/1069] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:40 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:41.552601 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:41.553209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:41.559044 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:41.559492 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:41.560734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:41.561162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:41.677575 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:41.684719 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ee411144-d9df-4a03-9f2a-08865431db57 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.135774 Aug 25 01:35:41.685287 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 552/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:41 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:41.928739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:41.929383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:41.935187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:41.935640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:41.936398 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:41.936834 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.052787 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:42.060425 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:42.061920 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:42.063084 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5431c1cd-543d-4104-9fe1-6fe8053d5ff5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.137995 Aug 25 01:35:42.063644 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 519/1071] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:41 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 01:35:42.203263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:42.204158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:42.209824 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.210269 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.211064 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.211495 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.278660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e250c2c6-dd11-4893-bfc8-5879348e31cb tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action" status: 202 len: 0 microversion: 2.1 time: 0.079474 Aug 25 01:35:42.282718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 553/1072] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:35:42 2021] POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:35:42.288491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:42.289187 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:42.295002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.295449 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.296515 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.297034 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.420870 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:42.428576 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6060bbd0-2655-4b32-a779-baf0a3fffcf8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1751 microversion: 2.1 time: 0.143873 Aug 25 01:35:42.429173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 520/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:42 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1751 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:42.701653 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:42.702351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:42.708455 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.708899 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.709691 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:42.710123 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:42.827539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:42.835094 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fb8cee33-3d60-44eb-9ab4-51eae084f10e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.137516 Aug 25 01:35:42.835656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 554/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:42 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:43.080894 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:43.081456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:43.087078 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.087524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.088279 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.088709 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.204341 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:43.211836 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:43.213314 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:43.214422 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8afd1a8a-f4d9-4cb1-8a61-f96f49eae612 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.137362 Aug 25 01:35:43.215007 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 521/1075] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:43 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:43.445418 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:43.446054 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:43.451908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.452355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.453109 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.453538 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.573744 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:43.581396 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-95b1fa07-ccfc-48e8-9de4-e88c90cc5eab tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.139634 Aug 25 01:35:43.581953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 555/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:43 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:43.851664 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:43.852194 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:43.857949 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.858395 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.859251 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:43.859789 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:43.975157 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:43.982257 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5f0e2ac4-df43-4e45-8677-f94ae498607e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.134388 Aug 25 01:35:43.982848 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 522/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:43 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:44.232281 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:44.232898 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:44.238655 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:44.239136 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:44.239901 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:44.240340 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:44.357116 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:44.365028 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:44.366531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:44.367737 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-898703ad-1c19-440f-b32e-fd3ded6f416b tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.139190 Aug 25 01:35:44.368298 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 556/1078] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:44 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:44.598287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:44.598937 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:44.604879 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:44.605336 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:44.606188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:44.607180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:44.728504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:44.736551 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-cfde3ee7-a84c-4efe-bf82-ebd9593d3888 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.142195 Aug 25 01:35:44.737109 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 523/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:44 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:44.998806 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:44.999527 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:45.005252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.005703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.006466 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.006927 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.125293 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:45.132467 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7993b38b-8856-4449-ba3b-86e099ed8e72 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.137352 Aug 25 01:35:45.133021 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 557/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:44 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:45.386392 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:45.386934 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:45.393148 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.393595 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.394342 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.394794 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.509650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:45.517723 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:45.519258 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:45.520375 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6c5b4828-c44a-4a47-856c-abb90e46e40f tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.138052 Aug 25 01:35:45.520919 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 524/1081] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:45 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:45.753046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:45.753652 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:45.759330 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.760020 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.760769 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:45.761193 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:45.880427 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:45.888477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b6154a09-c13c-4f7d-900c-c3a32f404815 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.138865 Aug 25 01:35:45.889225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 558/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:45 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:46.149252 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:46.149802 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:46.156175 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.156625 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.157382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.157816 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.273466 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:46.281207 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a5c8b531-ecc7-4dac-9f48-bfbeba29ee89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.135733 Aug 25 01:35:46.281845 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 525/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:46 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:46.379549 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-e95adba2-84ba-4978-babf-d0a24209789c req-26b3d377-79fa-40fd-b09a-2b8c1f83f13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf42ba6b-d50a-40e1-9125-f726ddb5be2a", "name": "network-vif-plugged", "status": "completed", "tag": "7cbfb58b-250b-434a-a8f8-a66c796334e4"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:46.381210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:46.381210 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:46.389092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-e95adba2-84ba-4978-babf-d0a24209789c req-26b3d377-79fa-40fd-b09a-2b8c1f83f13b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.389537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-e95adba2-84ba-4978-babf-d0a24209789c req-26b3d377-79fa-40fd-b09a-2b8c1f83f13b service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.400308 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-e95adba2-84ba-4978-babf-d0a24209789c req-26b3d377-79fa-40fd-b09a-2b8c1f83f13b service nova] Creating event network-vif-plugged:7cbfb58b-250b-434a-a8f8-a66c796334e4 for instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a on hv-cinder-79001 Aug 25 01:35:46.405751 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-e95adba2-84ba-4978-babf-d0a24209789c req-26b3d377-79fa-40fd-b09a-2b8c1f83f13b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029871 Aug 25 01:35:46.406516 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 559/1084] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:35:46.539026 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:46.539640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:46.550239 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.550725 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.551507 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.551972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.686468 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:46.694549 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:46.696100 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:46.697239 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-243efce6-9245-44f3-93c9-0d207b007137 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.161907 Aug 25 01:35:46.697790 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 526/1085] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:46 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:46.906608 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:46.907350 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:46.913252 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.913692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:46.914435 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:46.914894 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:47.034985 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:47.042517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-54636bcc-1975-41d3-a364-6a1311906bfc tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.140344 Aug 25 01:35:47.043105 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 560/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:46 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:47.297750 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:47.298292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:47.304073 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:47.304535 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:47.305295 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:47.305731 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:47.420102 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:47.427242 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-e4809ba1-c060-46e3-8dab-77b6c3db2ada tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1266 microversion: 2.1 time: 0.133243 Aug 25 01:35:47.427804 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 527/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:47 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:47.715120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:47.715753 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:47.721445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:47.721891 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:47.722640 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:47.723163 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:47.844547 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:47.852250 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:47.853783 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:47.854984 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-06946476-f057-4bd2-adf0-f0c86b175c20 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.143590 Aug 25 01:35:47.855539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 561/1088] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:47 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:48.059262 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:48.060452 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:48.066135 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.066587 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.067382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.067824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.187829 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:48.195440 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-773ae83b-0885-4a82-8004-578444a3ef60 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.139966 Aug 25 01:35:48.196002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 528/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:48 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:48.426546 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-816ddf92-bc56-4dc1-9f01-6c09ea3e58e5 req-b89a06ec-326e-4482-9370-13cb3ef23f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "name": "network-vif-plugged", "status": "completed", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:48.429203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:48.429203 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:48.435925 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-816ddf92-bc56-4dc1-9f01-6c09ea3e58e5 req-b89a06ec-326e-4482-9370-13cb3ef23f6f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.436364 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-816ddf92-bc56-4dc1-9f01-6c09ea3e58e5 req-b89a06ec-326e-4482-9370-13cb3ef23f6f service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.443506 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:48.444121 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:48.446943 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-816ddf92-bc56-4dc1-9f01-6c09ea3e58e5 req-b89a06ec-326e-4482-9370-13cb3ef23f6f service nova] Creating event network-vif-plugged:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:35:48.449729 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.450191 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.451000 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.451474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.451842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-816ddf92-bc56-4dc1-9f01-6c09ea3e58e5 req-b89a06ec-326e-4482-9370-13cb3ef23f6f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028859 Aug 25 01:35:48.452623 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 562/1090] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:35:48.571686 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:48.580338 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-98f0b636-24a1-4236-a48c-a931c52f0249 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1453 microversion: 2.1 time: 0.140431 Aug 25 01:35:48.580897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 529/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:48 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:48.596893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:48.597588 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:48.603684 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.604136 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.604903 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.605341 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.723785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:48.731046 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9d621f38-e744-4564-8d0e-e013b3d36eee tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1453 microversion: 2.1 time: 0.138104 Aug 25 01:35:48.731639 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 563/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:48 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:48.873901 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:48.874502 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:48.880533 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.881059 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:48.881854 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:48.882269 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:49.012700 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:49.024370 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:49.027233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:49.029715 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6be7926c-5105-4090-aaf7-c5161e725bec tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.159755 Aug 25 01:35:49.046710 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 530/1093] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:48 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:49.212224 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:49.212870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:49.219334 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:49.219787 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:49.220553 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:49.220986 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:49.339370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:49.347593 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-594a523b-536f-415c-aea4-952cece2771f tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.139061 Aug 25 01:35:49.348154 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 564/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:49 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:50.057247 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:50.058500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:50.065538 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:50.066348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:50.067508 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:50.068156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:50.195252 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:50.204215 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:50.206115 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:50.207477 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9fa46c34-4c8a-498a-8855-e2ba0263fd0d tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1732 microversion: 2.20 time: 0.154184 Aug 25 01:35:50.208311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 531/1095] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:50 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:50.338239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-1186eb73-0ce3-4063-9d6a-d7e5c540c7f4 req-b2a73a2e-595a-4865-aa92-ad4794c4e12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf42ba6b-d50a-40e1-9125-f726ddb5be2a", "tag": "7cbfb58b-250b-434a-a8f8-a66c796334e4"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:35:50.340289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:35:50.340289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:35:50.347586 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-1186eb73-0ce3-4063-9d6a-d7e5c540c7f4 req-b2a73a2e-595a-4865-aa92-ad4794c4e12a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:50.348355 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-1186eb73-0ce3-4063-9d6a-d7e5c540c7f4 req-b2a73a2e-595a-4865-aa92-ad4794c4e12a service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:50.362485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-1186eb73-0ce3-4063-9d6a-d7e5c540c7f4 req-b2a73a2e-595a-4865-aa92-ad4794c4e12a service nova] Creating event network-changed:7cbfb58b-250b-434a-a8f8-a66c796334e4 for instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a on hv-cinder-79001 Aug 25 01:35:50.365330 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:50.365951 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:50.368423 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-1186eb73-0ce3-4063-9d6a-d7e5c540c7f4 req-b2a73a2e-595a-4865-aa92-ad4794c4e12a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Aug 25 01:35:50.369847 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 565/1096] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:35:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:35:50.374454 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:50.375004 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:50.375956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:50.376460 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:50.520156 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:50.528912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c5da4591-c10e-403e-abc9-2d9e042b8a55 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.166822 Aug 25 01:35:50.528912 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 532/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:50 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:35:51.225893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:51.226957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:51.233559 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:51.234006 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:51.234805 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:51.235238 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:51.357256 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:51.365267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:51.366802 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:51.367955 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-2066013c-2a29-42ec-91a9-d5b5c69dc197 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1719 microversion: 2.20 time: 0.146121 Aug 25 01:35:51.368511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 566/1098] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:35:51 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1719 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:35:51.545734 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:51.546374 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:51.552267 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:51.553067 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:51.553871 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:51.554304 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:51.674294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:51.681863 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-33ecb25b-7bbc-4e0a-8713-09d0231953ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.140485 Aug 25 01:35:51.682408 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 533/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:51 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:52.698740 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:52.699351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:52.705189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:52.705630 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:52.706382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:52.706846 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:52.827539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:52.835177 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ddd46680-1633-451d-bbfc-bb03ff7262e5 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1756 microversion: 2.1 time: 0.140079 Aug 25 01:35:52.835738 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 567/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:52 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:35:53.852003 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:35:53.852629 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:35:53.858292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:53.858759 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:53.859611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:35:53.860303 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:35:53.978208 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:35:53.986278 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-054b71cf-7e5b-4739-acf8-2446da5644ae tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1759 microversion: 2.1 time: 0.138366 Aug 25 01:35:53.986861 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 534/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:35:53 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1759 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:36:24.330505 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:24.331498 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:24.337239 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.337688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.338446 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.338909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.367161 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-6f85fa7b-daa6-448f-99b3-39a6db578777 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040580 Aug 25 01:36:24.367698 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 568/1102] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Aug 25 01:36:24 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:36:24.426640 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:24.427150 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:24.433207 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.433659 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.434459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.434924 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.458329 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:36:24.532654 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-4d8c2edc-bbb8-4b05-a5d2-7694625149bb tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 204 len: 0 microversion: 2.20 time: 0.109427 Aug 25 01:36:24.533227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 535/1103] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Aug 25 01:36:24 2021] DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 01:36:24.541648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:24.542342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:24.548845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.549296 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.550053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:24.550484 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:24.665158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:24.673391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:24.674917 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:24.676050 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fdbd4fa0-86a2-4c27-9439-6f7514e1df4a tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.138411 Aug 25 01:36:24.676596 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 569/1104] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:36:24 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:36:25.695270 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:25.695980 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:25.702276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:25.702752 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:25.703531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:25.703973 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:25.828634 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:25.836276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:25.837763 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:25.838920 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-7f3d070d-2eca-4215-baa5-6c72639d1678 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1725 microversion: 2.20 time: 0.148592 Aug 25 01:36:25.839469 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 536/1105] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:36:25 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:36:26.856723 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:26.857967 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:26.864718 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:26.865003 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:26.865778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:26.866209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:26.901885 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-fa297820-727d-425d-b63b-8fde698eea9b req-deead456-d20f-4ebb-b632-78563dfb62ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820736cb-49e0-4cb7-b3da-cf2365ddbc9d", "name": "network-vif-deleted", "tag": "ed1853e7-475b-4b17-a478-66dd9dab4911"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:26.904946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:36:26.904946 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:36:26.912623 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-fa297820-727d-425d-b63b-8fde698eea9b req-deead456-d20f-4ebb-b632-78563dfb62ee service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:26.913136 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-fa297820-727d-425d-b63b-8fde698eea9b req-deead456-d20f-4ebb-b632-78563dfb62ee service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:26.925287 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-fa297820-727d-425d-b63b-8fde698eea9b req-deead456-d20f-4ebb-b632-78563dfb62ee service nova] Creating event network-vif-deleted:ed1853e7-475b-4b17-a478-66dd9dab4911 for instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d on hv-cinder-79001 Aug 25 01:36:26.930755 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-fa297820-727d-425d-b63b-8fde698eea9b req-deead456-d20f-4ebb-b632-78563dfb62ee service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Aug 25 01:36:26.931585 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 537/1106] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:26.947957 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:26.957098 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:26.958593 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8a2c266dd464ce2a957aa7960049b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d3f6d9b58da4cf08feb13c48725af79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:26.959887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ed68b808-f369-41e1-8e3f-b86adbd55049 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 200 len: 1657 microversion: 2.20 time: 0.106747 Aug 25 01:36:26.971641 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 570/1107] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:36:26 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 1657 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 01:36:27.979345 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:27.980071 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:27.986956 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:27.987541 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:27.988414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:27.988943 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:28.003173 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. Aug 25 01:36:28.003855 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:28.004761 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f011717c-6ba4-4acb-a454-23d843107136 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 404 len: 111 microversion: 2.20 time: 0.029474 Aug 25 01:36:28.005548 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 538/1108] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Aug 25 01:36:27 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 01:36:28.014839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-347b4bc1-c915-401d-96a9-7d9b3191e2b6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '.version_select at 0x7fd58db2b160>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:28.032721 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-347b4bc1-c915-401d-96a9-7d9b3191e2b6 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536499264" status: 204 len: 0 microversion: 2.20 time: 0.022194 Aug 25 01:36:28.033282 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 571/1109] 10.222.0.23 () {60 vars in 1262 bytes} [Wed Aug 25 01:36:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1536499264 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 01:36:29.715328 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-620304675"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:29.715880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:29.722411 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:29.722892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:29.723643 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:29.724070 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:29.836431 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.network.security_group_api [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Removing security group 2ef5458f-e27e-4a5e-98f6-42612c586ccb from port fe36350f-e1e6-4353-a67f-60cd29711bb6 Aug 25 01:36:29.981343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:29.981842 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:29.987548 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:29.987987 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:29.988747 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:29.989173 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:30.002328 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. Aug 25 01:36:30.002942 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:30.003757 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7499dace-cc3a-4f60-b823-dc166205b7b5 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 404 len: 111 microversion: 2.1 time: 0.026073 Aug 25 01:36:30.004279 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 572/1110] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:36:29 2021] DELETE /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:30.011703 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:30.012303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 820736cb-49e0-4cb7-b3da-cf2365ddbc9d] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:30.018189 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:30.018627 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:30.019411 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:30.019858 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:30.032996 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. Aug 25 01:36:30.033570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 820736cb-49e0-4cb7-b3da-cf2365ddbc9d could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:30.034421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-59ac3eb9-b3ef-439d-8da6-36919535b9ad tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d" status: 404 len: 111 microversion: 2.1 time: 0.026266 Aug 25 01:36:30.034924 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 573/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:30 2021] GET /compute/v2.1/servers/820736cb-49e0-4cb7-b3da-cf2365ddbc9d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:30.164842 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-15cbbc93-ef76-45b0-96bd-993878a548b9 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action" status: 202 len: 0 microversion: 2.1 time: 0.452487 Aug 25 01:36:30.165636 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 539/1112] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Aug 25 01:36:29 2021] POST /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:36:30.174180 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-58c7ef4d-e74e-4634-942d-6cb7fb9e904c req-7db66c85-0b42-4c46-b3ef-20f4381ff2ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:30.175688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:36:30.175688 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:36:30.184692 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-58c7ef4d-e74e-4634-942d-6cb7fb9e904c req-7db66c85-0b42-4c46-b3ef-20f4381ff2ca service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:30.185131 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-58c7ef4d-e74e-4634-942d-6cb7fb9e904c req-7db66c85-0b42-4c46-b3ef-20f4381ff2ca service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:30.197855 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-58c7ef4d-e74e-4634-942d-6cb7fb9e904c req-7db66c85-0b42-4c46-b3ef-20f4381ff2ca service nova] Creating event network-changed:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:36:30.208782 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-58c7ef4d-e74e-4634-942d-6cb7fb9e904c req-7db66c85-0b42-4c46-b3ef-20f4381ff2ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038277 Aug 25 01:36:30.209852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 574/1113] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:36:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:31.179380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:31.179925 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:31.185650 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.186104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.186906 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.187346 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.200578 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. Aug 25 01:36:31.201176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:31.201992 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8aad0aad-47d2-4c8d-82ad-828b1ccf6bb4 tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 404 len: 111 microversion: 2.1 time: 0.026274 Aug 25 01:36:31.202524 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 540/1114] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:36:31 2021] DELETE /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:31.210735 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:31.211436 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] [instance: 4062759a-7420-4110-8d0c-77cbbc615973] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:31.217795 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.218246 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.219039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.219476 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.232185 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] HTTP exception thrown: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. Aug 25 01:36:31.233286 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] Returning 404 to user: Instance 4062759a-7420-4110-8d0c-77cbbc615973 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:31.234100 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-9fd98875-3bfe-484e-bb22-a8e5918923ce tempest-AttachVolumeShelveTestJSON-1550324816 tempest-AttachVolumeShelveTestJSON-1550324816-project] 10.222.0.23 "GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973" status: 404 len: 111 microversion: 2.1 time: 0.027360 Aug 25 01:36:31.234621 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 575/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:31 2021] GET /compute/v2.1/servers/4062759a-7420-4110-8d0c-77cbbc615973 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:36:31.280363 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:31.281193 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:31.287044 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.287496 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.288265 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.288884 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.373597 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lazy-loading 'services' on Instance uuid 51e25606-3995-4289-9dbd-aee1fe109267 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:36:31.442188 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c654bbc3-98b0-447d-ae34-ac9218a3f3cd tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments/90af8fc7-e925-4afb-828f-af8e4c2b3fce" status: 202 len: 0 microversion: 2.1 time: 0.165864 Aug 25 01:36:31.446457 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 541/1116] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:36:31 2021] DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments/90af8fc7-e925-4afb-828f-af8e4c2b3fce => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:36:31.454590 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:31.455535 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:31.462763 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.463970 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.466023 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:31.467332 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:31.507945 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cdbdc6c4-5aa7-43ad-87fb-fb8bf9cce0b0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060477 Aug 25 01:36:31.509391 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 576/1117] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:36:31 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:36:32.230204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-d093b592-e431-4844-ae95-fa282dbc510d req-488cac29-7c2f-497c-9493-0fc8051a3854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:32.233080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:36:32.233080 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:36:32.242161 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-d093b592-e431-4844-ae95-fa282dbc510d req-488cac29-7c2f-497c-9493-0fc8051a3854 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:32.244032 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-d093b592-e431-4844-ae95-fa282dbc510d req-488cac29-7c2f-497c-9493-0fc8051a3854 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:32.256846 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-d093b592-e431-4844-ae95-fa282dbc510d req-488cac29-7c2f-497c-9493-0fc8051a3854 service nova] Creating event network-changed:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:36:32.262211 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-d093b592-e431-4844-ae95-fa282dbc510d req-488cac29-7c2f-497c-9493-0fc8051a3854 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036743 Aug 25 01:36:32.262824 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 542/1118] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:36:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:36:32.520180 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:32.521092 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:32.526926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:32.527380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:32.528150 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:32.528583 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:32.556963 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-34871a5b-7987-4749-856c-5cbd2780c5ea tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040490 Aug 25 01:36:32.557521 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 577/1119] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Aug 25 01:36:32 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 01:36:32.568459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:32.569065 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:32.575241 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:32.575611 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:32.576361 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:32.576801 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:32.654730 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] HTTP exception thrown: Instance 51e25606-3995-4289-9dbd-aee1fe109267 is not attached to volume 90af8fc7-e925-4afb-828f-af8e4c2b3fce Aug 25 01:36:32.655357 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Returning 404 to user: Instance 51e25606-3995-4289-9dbd-aee1fe109267 is not attached to volume 90af8fc7-e925-4afb-828f-af8e4c2b3fce {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:32.656202 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-84c7b7d3-acf2-49da-a324-78a7429ce7d8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments/90af8fc7-e925-4afb-828f-af8e4c2b3fce" status: 404 len: 154 microversion: 2.1 time: 0.091925 Aug 25 01:36:32.656748 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 543/1120] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Aug 25 01:36:32 2021] DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267/os-volume_attachments/90af8fc7-e925-4afb-828f-af8e4c2b3fce => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:36:33.795115 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:33.796190 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:33.801987 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:33.802618 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:33.803477 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:33.803906 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:33.828065 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:36:33.906368 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ab02dd5a-fd84-45fc-9358-08db4b880719 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 204 len: 0 microversion: 2.1 time: 0.115264 Aug 25 01:36:33.907430 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 578/1121] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:36:33 2021] DELETE /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:36:33.915519 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:33.916060 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:33.923550 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:33.924276 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:33.925222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:33.925652 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:34.143580 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:34.150856 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-126d7124-8c74-4405-afed-0296c460e4c0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1555 microversion: 2.1 time: 0.239042 Aug 25 01:36:34.151414 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 544/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:33 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:36:35.171380 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:35.171946 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:35.178470 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:35.179071 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:35.179865 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:35.180343 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:35.304421 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:35.312339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d0e0996c-aaa5-4ebb-aa57-85eef3ac5f1a tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1555 microversion: 2.1 time: 0.146574 Aug 25 01:36:35.312881 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 579/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:35 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:36:35.964850 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9daa66fd-a04a-4cca-b4e5-371be578cc1a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Action: 'create', calling method: .version_select at 0x7fd58d90bd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-569410248"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:36.187234 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-82143ddf-2655-4adf-8242-f3987228760b req-9c1f1fd4-a139-431d-b27d-31eaa7ab8613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e25606-3995-4289-9dbd-aee1fe109267", "name": "network-vif-deleted", "tag": "fe36350f-e1e6-4353-a67f-60cd29711bb6"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:36.188947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:36:36.188947 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:36:36.196144 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-82143ddf-2655-4adf-8242-f3987228760b req-9c1f1fd4-a139-431d-b27d-31eaa7ab8613 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:36.196860 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-82143ddf-2655-4adf-8242-f3987228760b req-9c1f1fd4-a139-431d-b27d-31eaa7ab8613 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:36.220424 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-82143ddf-2655-4adf-8242-f3987228760b req-9c1f1fd4-a139-431d-b27d-31eaa7ab8613 service nova] Creating event network-vif-deleted:fe36350f-e1e6-4353-a67f-60cd29711bb6 for instance 51e25606-3995-4289-9dbd-aee1fe109267 on hv-cinder-79001 Aug 25 01:36:36.225158 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-82143ddf-2655-4adf-8242-f3987228760b req-9c1f1fd4-a139-431d-b27d-31eaa7ab8613 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041730 Aug 25 01:36:36.225843 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 580/1124] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:36:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:36.261977 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9daa66fd-a04a-4cca-b4e5-371be578cc1a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.407311 Aug 25 01:36:36.262904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 545/1125] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Aug 25 01:36:35 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 409 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 01:36:36.275188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b885c921-fe62-43d6-8c6f-a7a7f7016273 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da881f0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:36.329629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b885c921-fe62-43d6-8c6f-a7a7f7016273 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 200 len: 344 microversion: 2.1 time: 0.058879 Aug 25 01:36:36.330195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 581/1126] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:36:36 2021] GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:36.332696 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:36.333311 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:36.339279 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:36.339730 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:36.340498 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:36.340936 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:36.370985 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:36.371435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:36.371889 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lazy-loading 'fault' on Instance uuid 51e25606-3995-4289-9dbd-aee1fe109267 {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:36:36.411079 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b39db8c6d1a4a7591acabe30d1cc60b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd502484c4f842cab183438793976e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:36:36.418197 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-23afbb10-2e3b-4961-a7a2-309704f69731 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 200 len: 1349 microversion: 2.1 time: 0.093017 Aug 25 01:36:36.418774 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 546/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:36 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:36:37.342017 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-393c0837-c842-4623-a47c-0d10f27a1d4a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58daacd30>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.391370 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-393c0837-c842-4623-a47c-0d10f27a1d4a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 200 len: 345 microversion: 2.1 time: 0.053027 Aug 25 01:36:37.391914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 582/1128] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:36:37 2021] GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:37.402472 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-468dd1bb-cf47-4690-8a23-49082d2eb64a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Action: 'create', calling method: .version_select at 0x7fd58da3b550>, body: {"snapshot": {"volume_id": "2b999146-bd6a-4144-8fc6-b5fcf76f64be", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1047581612"}} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:36:37.434760 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.436085 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] [instance: 51e25606-3995-4289-9dbd-aee1fe109267] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:36:37.442428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:37.442906 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:37.443671 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:36:37.444133 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:36:37.456764 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] HTTP exception thrown: Instance 51e25606-3995-4289-9dbd-aee1fe109267 could not be found. Aug 25 01:36:37.457349 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Returning 404 to user: Instance 51e25606-3995-4289-9dbd-aee1fe109267 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:37.458162 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c5e0d33a-8c26-432a-bc66-3f84e95f8eb0 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267" status: 404 len: 111 microversion: 2.1 time: 0.027160 Aug 25 01:36:37.458854 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 583/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:36:37 2021] GET /compute/v2.1/servers/51e25606-3995-4289-9dbd-aee1fe109267 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:37.467000 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cbb2e843-7726-48c0-a117-08580f62a1b8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] Calling method '.version_select at 0x7fd58fbf1dc0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.485580 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cbb2e843-7726-48c0-a117-08580f62a1b8 tempest-TestMinimumBasicScenario-664829771 tempest-TestMinimumBasicScenario-664829771-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1889544522" status: 202 len: 0 microversion: 2.1 time: 0.022574 Aug 25 01:36:37.486245 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 584/1130] 10.222.0.23 () {58 vars in 1272 bytes} [Wed Aug 25 01:36:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1889544522 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 01:36:37.552645 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-468dd1bb-cf47-4690-8a23-49082d2eb64a tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153724 Aug 25 01:36:37.553610 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 547/1131] 10.222.0.23 () {60 vars in 1162 bytes} [Wed Aug 25 01:36:37 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:37.564258 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-19699926-654a-48dd-b930-757052358ed7 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58db2ba60>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.595348 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-19699926-654a-48dd-b930-757052358ed7 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 287 microversion: 2.1 time: 0.036220 Aug 25 01:36:37.596202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 585/1132] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:37 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:37.605292 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-26b29574-d500-4455-bfa6-ddfb2f10f50b tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d925550>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.633665 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-26b29574-d500-4455-bfa6-ddfb2f10f50b tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031910 Aug 25 01:36:37.634476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 548/1133] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Aug 25 01:36:37 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:37.644183 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4160b02a-2923-4bf4-8ddd-9f23584e4a17 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da7fee0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:37.672101 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4160b02a-2923-4bf4-8ddd-9f23584e4a17 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 287 microversion: 2.1 time: 0.031405 Aug 25 01:36:37.672643 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 586/1134] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:37 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:38.683541 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-2f6e55ec-49bf-46ae-b3b5-e5f15bec5627 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d8bb310>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:38.712955 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-2f6e55ec-49bf-46ae-b3b5-e5f15bec5627 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 287 microversion: 2.1 time: 0.033076 Aug 25 01:36:38.713545 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 549/1135] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:38 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:39.723933 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5c460316-3b09-4fc1-af9a-41deb9cd1b9d tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da87ca0>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:39.754500 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5c460316-3b09-4fc1-af9a-41deb9cd1b9d tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 287 microversion: 2.1 time: 0.034135 Aug 25 01:36:39.755367 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 587/1136] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:39 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:40.767104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-713be675-7f0a-474d-87ae-f57a086cd118 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d9251f0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:40.803381 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-713be675-7f0a-474d-87ae-f57a086cd118 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 288 microversion: 2.1 time: 0.040335 Aug 25 01:36:40.808719 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 550/1137] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:40 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:40.813644 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-90ac7018-d122-485c-83e8-df8e589774cc tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da87790>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:40.885099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-90ac7018-d122-485c-83e8-df8e589774cc tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 202 len: 0 microversion: 2.1 time: 0.074987 Aug 25 01:36:40.886512 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 588/1138] 10.222.0.23 () {58 vars in 1254 bytes} [Wed Aug 25 01:36:40 2021] DELETE /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:36:40.894631 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-6b642d1b-c9bb-4711-9bff-4946b27d97aa tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da3b550>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:40.935923 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-6b642d1b-c9bb-4711-9bff-4946b27d97aa tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 200 len: 287 microversion: 2.1 time: 0.044918 Aug 25 01:36:40.936556 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 551/1139] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:40 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 01:36:41.947507 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38d56240-df7e-4c82-8d47-5408b0f7c899 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58daa4700>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:41.970231 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-38d56240-df7e-4c82-8d47-5408b0f7c899 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] HTTP exception thrown: Snapshot 6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 could not be found. Aug 25 01:36:41.970909 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-38d56240-df7e-4c82-8d47-5408b0f7c899 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Returning 404 to user: Snapshot 6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:41.971742 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-38d56240-df7e-4c82-8d47-5408b0f7c899 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0" status: 404 len: 111 microversion: 2.1 time: 0.028110 Aug 25 01:36:41.972278 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 589/1140] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Aug 25 01:36:41 2021] GET /compute/v2.1/os-snapshots/6a1b426c-2a8c-46ef-8dc8-cf952b1419d0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:36:41.980383 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-37212f3a-cb1a-4e69-8ba4-010a66dc2ab6 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d90b280>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:42.038168 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-37212f3a-cb1a-4e69-8ba4-010a66dc2ab6 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 202 len: 0 microversion: 2.1 time: 0.061269 Aug 25 01:36:42.038876 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 552/1141] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:36:41 2021] DELETE /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:36:42.047807 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ec043184-10fa-4446-bf87-91411a174211 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58da88e50>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:42.099289 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ec043184-10fa-4446-bf87-91411a174211 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 200 len: 344 microversion: 2.1 time: 0.055694 Aug 25 01:36:42.099852 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 590/1142] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:36:42 2021] GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:36:43.111039 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f897ed48-e282-41cb-8f0b-b39034001f60 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d9191f0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:43.140118 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-f897ed48-e282-41cb-8f0b-b39034001f60 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] HTTP exception thrown: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. Aug 25 01:36:43.140837 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-f897ed48-e282-41cb-8f0b-b39034001f60 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Returning 404 to user: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:43.141878 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-f897ed48-e282-41cb-8f0b-b39034001f60 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 404 len: 109 microversion: 2.1 time: 0.034574 Aug 25 01:36:43.142757 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 553/1143] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:36:43 2021] GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:36:43.156004 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-936810b5-3487-4f95-a1ca-50d80600c76f tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58e727280>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:43.183440 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-936810b5-3487-4f95-a1ca-50d80600c76f tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] HTTP exception thrown: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. Aug 25 01:36:43.184039 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-936810b5-3487-4f95-a1ca-50d80600c76f tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Returning 404 to user: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:43.185393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-936810b5-3487-4f95-a1ca-50d80600c76f tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 404 len: 109 microversion: 2.1 time: 0.032662 Aug 25 01:36:43.186081 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 591/1144] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Aug 25 01:36:43 2021] DELETE /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:36:43.193928 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9dc31f74-c5e0-4482-927c-297021c0e8f9 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Calling method '.version_select at 0x7fd58d90b1f0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:36:43.221736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-9dc31f74-c5e0-4482-927c-297021c0e8f9 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] HTTP exception thrown: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. Aug 25 01:36:43.222390 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-9dc31f74-c5e0-4482-927c-297021c0e8f9 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] Returning 404 to user: Volume 2b999146-bd6a-4144-8fc6-b5fcf76f64be could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:36:43.223412 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-9dc31f74-c5e0-4482-927c-297021c0e8f9 tempest-VolumesSnapshotsTestJSON-371398888 tempest-VolumesSnapshotsTestJSON-371398888-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be" status: 404 len: 109 microversion: 2.1 time: 0.033133 Aug 25 01:36:43.223961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 554/1145] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Aug 25 01:36:43 2021] GET /compute/v2.1/os-volumes/2b999146-bd6a-4144-8fc6-b5fcf76f64be => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:37:23.932395 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:37:23.933183 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: Wed Aug 25 01:37:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:37:38.077794 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1513818966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1574037462", "security_groups": [{"name": "tempest-secgroup-smoke-1998696762"}], "block_device_mapping_v2": [{"uuid": "b745c74a-959c-4b24-9d69-3deb69d5e919", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "109ccc69-61fe-42e8-83da-81c7da1807b8"}]}} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:37:38.282611 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.network.neutron [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] validate_networks() for [('109ccc69-61fe-42e8-83da-81c7da1807b8', None, None, None, None, None)] {{(pid=108271) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 25 01:37:38.640068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 01:37:38.640485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image limits 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 01:37:38.640953 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Flavor pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 01:37:38.641849 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Image pref 0:0:0 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 01:37:38.642443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.virt.hardware [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108271) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 01:37:38.651845 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:38.652294 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:38.653095 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:38.653531 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:38.670615 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 25 01:37:38.674472 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.quota [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Getting quotas for user 2fba46fcf5a742d28b39d9fef9c91df5 and project ada43be06e92474191038a2b41a9f39b. Resources: {'cores', 'ram', 'instances'} {{(pid=108271) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 25 01:37:38.732711 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Going to run 1 instances... {{(pid=108271) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 25 01:37:38.734839 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b745c74a-959c-4b24-9d69-3deb69d5e919',volume_size=None,volume_type=None)] {{(pid=108271) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 25 01:37:38.852326 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-196b0a84-2116-4a47-9028-96fb089c5839 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.779582 Aug 25 01:37:38.852962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 592/1146] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Aug 25 01:37:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 01:37:38.860452 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6ba5c63e-4e8e-429e-ad95-fd9bb7d82b4d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 01:37:38.863886 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a301a9b6-7770-49d9-bcba-31f65cda32dd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:38.864404 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a301a9b6-7770-49d9-bcba-31f65cda32dd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:39.032250 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a301a9b6-7770-49d9-bcba-31f65cda32dd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:39.043699 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a301a9b6-7770-49d9-bcba-31f65cda32dd tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1095 microversion: 2.1 time: 0.184575 Aug 25 01:37:39.045997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 555/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:38 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1095 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:40.061225 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:40.062445 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:40.070831 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:40.071626 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:40.072733 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:40.073469 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:40.140908 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:40.149420 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-5bea7627-edd0-42db-889d-5e5321658361 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1211 microversion: 2.1 time: 0.091834 Aug 25 01:37:40.150041 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 593/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:40 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:41.147741 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-28bcf930-ab40-4459-aa28-4bddbfda3f5e req-b1170692-438a-4526-966b-0237585c551e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a8dc7a-f32b-40d0-9d60-95f15fa2e089", "tag": "d33aa8f8-e730-4711-9683-f9d85a2f5fcd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:37:41.150474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:37:41.150474 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:37:41.168770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:41.170154 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:41.179534 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:41.180018 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:41.181826 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:41.183099 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:41.192880 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] [6ba5c63e-4e8e-429e-ad95-fd9bb7d82b4d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 43258. Aug 25 01:37:41.198911 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-28bcf930-ab40-4459-aa28-4bddbfda3f5e req-b1170692-438a-4526-966b-0237585c551e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:41.199567 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-28bcf930-ab40-4459-aa28-4bddbfda3f5e req-b1170692-438a-4526-966b-0237585c551e service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:41.211023 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-28bcf930-ab40-4459-aa28-4bddbfda3f5e req-b1170692-438a-4526-966b-0237585c551e service nova] Creating event network-changed:d33aa8f8-e730-4711-9683-f9d85a2f5fcd for instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 on hv-cinder-79001 Aug 25 01:37:41.216281 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-28bcf930-ab40-4459-aa28-4bddbfda3f5e req-b1170692-438a-4526-966b-0237585c551e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073125 Aug 25 01:37:41.220113 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 556/1149] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:37:41.351964 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:41.359660 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-f3f86ed0-f85c-4925-930d-07f7302fa045 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.194996 Aug 25 01:37:41.370648 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 594/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:41 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:42.377950 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:42.378641 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:42.385456 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:42.385903 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:42.386670 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:42.387130 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:42.515125 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:42.522489 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-36ff91b5-7b4f-41bb-979e-fa3f7132ed6b tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.149061 Aug 25 01:37:42.523119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 557/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:42 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:43.539840 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:43.540629 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:43.547566 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:43.548011 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:43.548920 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:43.549366 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:43.683261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:43.690931 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-c950c052-10bd-463f-8b9b-bd3bb04b68d9 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.155171 Aug 25 01:37:43.691489 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 595/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:43 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:44.707829 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:44.708438 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:44.714085 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:44.714534 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:44.715329 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:44.715765 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:44.835786 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:44.843155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-8f9d5d5a-f010-439b-83e9-02bfe959442e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.139434 Aug 25 01:37:44.843941 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 558/1153] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:44 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:45.859024 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:45.860339 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:45.866342 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:45.866893 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:45.867727 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:45.868248 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:45.990574 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:45.998911 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-bf322879-001f-46f7-a00d-45d88e79498c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.143269 Aug 25 01:37:45.999474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 596/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:45 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:47.016530 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:47.017389 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:47.023657 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:47.024119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:47.024882 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:47.025319 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:47.141909 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:47.149134 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-ba0cbc5d-9e63-464b-bf87-4603626e742a tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.136410 Aug 25 01:37:47.149692 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 559/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:47 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:48.165485 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:48.166097 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:48.171863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:48.172351 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:48.173109 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:48.173540 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:48.287393 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:48.294461 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-8e206528-5e0e-4e42-a5d2-855e5c7572ca tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.132660 Aug 25 01:37:48.295053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 597/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:48 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:49.311397 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:49.312002 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:49.318204 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:49.318648 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:49.319427 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:49.319857 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:49.436822 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:49.444380 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-703489d0-3e32-4cbb-b6a0-48202d6e6ad7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.136642 Aug 25 01:37:49.444938 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 560/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:49 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:50.461167 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:50.461773 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:50.467518 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:50.467962 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:50.468725 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:50.469778 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:50.593539 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:50.601317 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-caf2b504-940d-47c5-a193-109fc0869147 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.143900 Aug 25 01:37:50.601875 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 598/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:50 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:51.617961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:51.618596 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:51.624424 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:51.624869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:51.625667 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:51.626094 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:51.740405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:51.747554 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-faf6d3bf-c81a-4969-b5a4-842c1cd8f4d3 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.133233 Aug 25 01:37:51.748104 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 561/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:51 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:52.764338 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:52.765511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:52.771517 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:52.772188 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:52.773127 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:52.773870 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:52.933484 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:52.949086 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-fd3f282b-5e12-46ca-9fd8-e172e3aa0d2d tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.188110 Aug 25 01:37:52.949694 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 599/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:52 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:53.053222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-649eab18-1f33-4b50-913e-63f55b27dfdc req-563a632a-5408-47f9-a0b3-81f5e3f9deb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a8dc7a-f32b-40d0-9d60-95f15fa2e089", "name": "network-vif-plugged", "status": "completed", "tag": "d33aa8f8-e730-4711-9683-f9d85a2f5fcd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:37:53.054758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:37:53.054758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:37:53.061628 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-649eab18-1f33-4b50-913e-63f55b27dfdc req-563a632a-5408-47f9-a0b3-81f5e3f9deb3 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:53.062068 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-649eab18-1f33-4b50-913e-63f55b27dfdc req-563a632a-5408-47f9-a0b3-81f5e3f9deb3 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:53.073687 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-649eab18-1f33-4b50-913e-63f55b27dfdc req-563a632a-5408-47f9-a0b3-81f5e3f9deb3 service nova] Creating event network-vif-plugged:d33aa8f8-e730-4711-9683-f9d85a2f5fcd for instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 on hv-cinder-79001 Aug 25 01:37:53.078758 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-649eab18-1f33-4b50-913e-63f55b27dfdc req-563a632a-5408-47f9-a0b3-81f5e3f9deb3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226263 Aug 25 01:37:53.079382 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 562/1161] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:37:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:37:53.967480 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:53.969222 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:53.975474 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:53.976033 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:53.976682 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:53.977181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:54.096524 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:54.104384 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-d0adde86-890b-41aa-8d93-a1c711cf5d5e tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1267 microversion: 2.1 time: 0.142541 Aug 25 01:37:54.104958 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 600/1162] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:53 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:55.122110 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:55.122768 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:55.128672 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:55.129119 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:55.129869 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:55.130294 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:55.252491 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:55.259945 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-5a4a3852-788b-4480-b6af-5ad769801746 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1454 microversion: 2.1 time: 0.141965 Aug 25 01:37:55.260500 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 563/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:55 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:55.276403 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:37:55.277009 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:37:55.283428 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:55.283879 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:55.284633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:55.285059 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:55.400216 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:37:55.407267 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-e7e5e3e0-6d30-43bd-9052-f595754cc809 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1454 microversion: 2.1 time: 0.134478 Aug 25 01:37:55.407818 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 601/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:37:55 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:37:57.172964 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-2d0bff86-4d24-4218-8e07-629d9cb9ee51 req-0a8ae467-1837-434f-9191-0e6f89812b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a8dc7a-f32b-40d0-9d60-95f15fa2e089", "tag": "d33aa8f8-e730-4711-9683-f9d85a2f5fcd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:37:57.174442 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:37:57.174442 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:37:57.181166 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2d0bff86-4d24-4218-8e07-629d9cb9ee51 req-0a8ae467-1837-434f-9191-0e6f89812b95 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:37:57.181604 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-2d0bff86-4d24-4218-8e07-629d9cb9ee51 req-0a8ae467-1837-434f-9191-0e6f89812b95 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:37:57.192105 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-2d0bff86-4d24-4218-8e07-629d9cb9ee51 req-0a8ae467-1837-434f-9191-0e6f89812b95 service nova] Creating event network-changed:d33aa8f8-e730-4711-9683-f9d85a2f5fcd for instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 on hv-cinder-79001 Aug 25 01:37:57.197076 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-2d0bff86-4d24-4218-8e07-629d9cb9ee51 req-0a8ae467-1837-434f-9191-0e6f89812b95 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028271 Aug 25 01:37:57.197635 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 564/1165] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:37:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:39:26.363120 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:26.363676 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:26.369792 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:26.370303 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:26.371112 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:26.371550 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:26.414607 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Going to try to terminate instance {{(pid=108271) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:39:26.496770 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-530f3223-67c0-41a2-ad03-345330de77c1 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 204 len: 0 microversion: 2.1 time: 0.138999 Aug 25 01:39:26.497675 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 602/1166] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:39:26 2021] DELETE /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:39:26.507015 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:26.507734 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:26.513804 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:26.514261 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:26.515135 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:26.515511 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:26.555249 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [req-f879351d-ef13-4a50-938e-52d581d8bafa req-00db096b-7581-4814-aca2-75e779dcb447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a8dc7a-f32b-40d0-9d60-95f15fa2e089", "tag": "d33aa8f8-e730-4711-9683-f9d85a2f5fcd"}]} {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:39:26.556795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:39:26.556795 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: warnings.warn(msg) Aug 25 01:39:26.564009 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-f879351d-ef13-4a50-938e-52d581d8bafa req-00db096b-7581-4814-aca2-75e779dcb447 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:26.564586 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [req-f879351d-ef13-4a50-938e-52d581d8bafa req-00db096b-7581-4814-aca2-75e779dcb447 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:26.575410 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.compute.server_external_events [req-f879351d-ef13-4a50-938e-52d581d8bafa req-00db096b-7581-4814-aca2-75e779dcb447 service nova] Creating event network-changed:d33aa8f8-e730-4711-9683-f9d85a2f5fcd for instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 on hv-cinder-79001 Aug 25 01:39:26.581291 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [req-f879351d-ef13-4a50-938e-52d581d8bafa req-00db096b-7581-4814-aca2-75e779dcb447 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219964 Aug 25 01:39:26.582268 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 565/1167] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:39:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:39:26.645443 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:26.652904 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-7d0781ee-a4f6-4ecc-88ed-7630e0fe78e7 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1579 microversion: 2.1 time: 0.149997 Aug 25 01:39:26.653506 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 603/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:26 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 01:39:27.671180 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:27.671875 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:27.679447 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:27.679897 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:27.680662 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:27.681099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:27.800820 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:27.808043 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-57282000-a8e2-45a1-8aea-9efff0200003 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1460 microversion: 2.1 time: 0.140852 Aug 25 01:39:27.808606 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 566/1169] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:27 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1460 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:39:28.614656 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-8003411a-1395-48a1-9a52-645c400a9daf req-b803d2ca-10a1-4c8e-9927-25dc3fb1e98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a8dc7a-f32b-40d0-9d60-95f15fa2e089", "name": "network-vif-deleted", "tag": "d33aa8f8-e730-4711-9683-f9d85a2f5fcd"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:39:28.616202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:39:28.616202 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:39:28.623053 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-8003411a-1395-48a1-9a52-645c400a9daf req-b803d2ca-10a1-4c8e-9927-25dc3fb1e98c service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:28.623496 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-8003411a-1395-48a1-9a52-645c400a9daf req-b803d2ca-10a1-4c8e-9927-25dc3fb1e98c service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:28.634560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-8003411a-1395-48a1-9a52-645c400a9daf req-b803d2ca-10a1-4c8e-9927-25dc3fb1e98c service nova] Creating event network-vif-deleted:d33aa8f8-e730-4711-9683-f9d85a2f5fcd for instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 on hv-cinder-79001 Aug 25 01:39:28.639230 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-8003411a-1395-48a1-9a52-645c400a9daf req-b803d2ca-10a1-4c8e-9927-25dc3fb1e98c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088001 Aug 25 01:39:28.639803 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 604/1170] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:39:28.824958 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:28.825866 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:28.832904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:28.833470 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:28.834358 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:28.834935 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:28.904997 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:28.913450 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-98cc4b02-bddb-4350-bf61-f2270d120d76 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 200 len: 1226 microversion: 2.1 time: 0.092492 Aug 25 01:39:28.914843 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 567/1171] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:28 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:39:29.931569 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:29.932256 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 64a8dc7a-f32b-40d0-9d60-95f15fa2e089] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:29.938670 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:29.939141 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:29.939891 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:29.940321 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:29.953229 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] HTTP exception thrown: Instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 could not be found. Aug 25 01:39:29.954464 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Returning 404 to user: Instance 64a8dc7a-f32b-40d0-9d60-95f15fa2e089 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:39:29.955284 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-ac004a46-1a16-4bbe-bc8d-844b7f2766c6 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089" status: 404 len: 111 microversion: 2.1 time: 0.027720 Aug 25 01:39:29.955785 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 605/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:29 2021] GET /compute/v2.1/servers/64a8dc7a-f32b-40d0-9d60-95f15fa2e089 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:39:33.192675 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:33.193305 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:33.195567 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-d6efee4f-30e4-4e0e-9dad-3e14351fdd7f req-bb33e9a6-714a-44e0-8ff5-ec8952c25995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf42ba6b-d50a-40e1-9125-f726ddb5be2a", "tag": "7cbfb58b-250b-434a-a8f8-a66c796334e4"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:39:33.197124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:39:33.197124 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:39:33.199348 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:33.199972 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:33.200739 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:33.201343 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:33.207926 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-d6efee4f-30e4-4e0e-9dad-3e14351fdd7f req-bb33e9a6-714a-44e0-8ff5-ec8952c25995 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:33.208450 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-d6efee4f-30e4-4e0e-9dad-3e14351fdd7f req-bb33e9a6-714a-44e0-8ff5-ec8952c25995 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:33.219528 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-d6efee4f-30e4-4e0e-9dad-3e14351fdd7f req-bb33e9a6-714a-44e0-8ff5-ec8952c25995 service nova] Creating event network-changed:7cbfb58b-250b-434a-a8f8-a66c796334e4 for instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a on hv-cinder-79001 Aug 25 01:39:33.224598 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-d6efee4f-30e4-4e0e-9dad-3e14351fdd7f req-bb33e9a6-714a-44e0-8ff5-ec8952c25995 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Aug 25 01:39:33.225263 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 606/1173] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:39:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:39:33.225526 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Going to try to terminate instance {{(pid=108270) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 25 01:39:33.303900 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-45f1ea89-6353-479e-a9dd-682e1d29780c tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 204 len: 0 microversion: 2.1 time: 0.115185 Aug 25 01:39:33.307749 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 568/1174] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:39:33 2021] DELETE /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 01:39:33.314702 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:33.315562 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:33.321666 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:33.322226 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:33.323138 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:33.323673 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:33.444058 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.policy [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108271) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:33.451876 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-b5203e31-1c4f-4b4b-b626-e17889b9f067 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1578 microversion: 2.1 time: 0.142067 Aug 25 01:39:33.458068 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 607/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:33 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:39:34.470099 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:34.470813 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:34.476531 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:34.476968 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:34.477713 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:34.478139 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:34.596736 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:34.603904 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-517bf69b-660a-41fe-b476-d8bc1d51c9af tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1459 microversion: 2.1 time: 0.137797 Aug 25 01:39:34.604455 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 569/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:34 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1459 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:39:35.255887 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [req-74d4274c-1866-43e0-9330-9a52cab1db4f req-84d23bac-0a77-4106-b467-d23fffc67445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf42ba6b-d50a-40e1-9125-f726ddb5be2a", "name": "network-vif-deleted", "tag": "7cbfb58b-250b-434a-a8f8-a66c796334e4"}]} {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 01:39:35.257863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 01:39:35.257863 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: warnings.warn(msg) Aug 25 01:39:35.266452 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-74d4274c-1866-43e0-9330-9a52cab1db4f req-84d23bac-0a77-4106-b467-d23fffc67445 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:35.266918 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [req-74d4274c-1866-43e0-9330-9a52cab1db4f req-84d23bac-0a77-4106-b467-d23fffc67445 service nova] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:35.277859 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.compute.server_external_events [req-74d4274c-1866-43e0-9330-9a52cab1db4f req-84d23bac-0a77-4106-b467-d23fffc67445 service nova] Creating event network-vif-deleted:7cbfb58b-250b-434a-a8f8-a66c796334e4 for instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a on hv-cinder-79001 Aug 25 01:39:35.284088 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [req-74d4274c-1866-43e0-9330-9a52cab1db4f req-84d23bac-0a77-4106-b467-d23fffc67445 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031835 Aug 25 01:39:35.284710 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 608/1177] 10.222.0.23 () {64 vars in 1318 bytes} [Wed Aug 25 01:39:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 01:39:35.620504 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:35.621122 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:35.627233 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:35.627685 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:35.628459 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:35.628892 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:35.811248 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:35.811704 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:35.812155 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.objects.instance [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lazy-loading 'fault' on Instance uuid bf42ba6b-d50a-40e1-9125-f726ddb5be2a {{(pid=108270) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 25 01:39:35.855405 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.policy [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fba46fcf5a742d28b39d9fef9c91df5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada43be06e92474191038a2b41a9f39b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108270) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 01:39:35.862832 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-a4172b7a-e214-457f-b421-e81eaec7aa89 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 200 len: 1230 microversion: 2.1 time: 0.245957 Aug 25 01:39:35.863412 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 570/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:35 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 1230 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 01:39:36.880307 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:36.880914 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: bf42ba6b-d50a-40e1-9125-f726ddb5be2a] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:36.887129 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:36.887570 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:36.888346 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:36.888771 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:36.901813 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] HTTP exception thrown: Instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a could not be found. Aug 25 01:39:36.902382 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Returning 404 to user: Instance bf42ba6b-d50a-40e1-9125-f726ddb5be2a could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:39:36.903204 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-cd3e2697-47d0-4ff3-95d7-48c8a9b2c967 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a" status: 404 len: 111 microversion: 2.1 time: 0.026967 Aug 25 01:39:36.903928 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 609/1179] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:36 2021] GET /compute/v2.1/servers/bf42ba6b-d50a-40e1-9125-f726ddb5be2a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:39:37.328429 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:37.329594 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.compute.api [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108270) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:37.335227 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:37.335677 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:37.336435 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:37.336868 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG oslo_concurrency.lockutils [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108270) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:37.349451 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.wsgi [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] HTTP exception thrown: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. Aug 25 01:39:37.350024 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Returning 404 to user: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. {{(pid=108270) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:39:37.350860 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-c2dbc37e-2843-4bde-97e3-0f94a656af85 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "DELETE /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 404 len: 111 microversion: 2.1 time: 0.026089 Aug 25 01:39:37.351355 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 571/1180] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Aug 25 01:39:37 2021] DELETE /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 01:39:37.359018 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '>' {{(pid=108271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:37.359633 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.compute.api [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] [instance: 311b6a44-51eb-49e3-aee1-e24c57a2d392] Fetching instance by UUID {{(pid=108271) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 25 01:39:37.365336 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:37.365788 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:37.366560 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 25 01:39:37.367037 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG oslo_concurrency.lockutils [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Lock "9a01fdc1-2222-4d37-81a2-e9e9ae7940c7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 25 01:39:37.380217 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.wsgi [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] HTTP exception thrown: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. Aug 25 01:39:37.380799 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: DEBUG nova.api.openstack.wsgi [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Returning 404 to user: Instance 311b6a44-51eb-49e3-aee1-e24c57a2d392 could not be found. {{(pid=108271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 25 01:39:37.381600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO nova.api.openstack.requestlog [None req-4c8e292b-ea69-4a2a-a86b-a24b52c560ae tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392" status: 404 len: 111 microversion: 2.1 time: 0.026272 Aug 25 01:39:37.382128 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: [pid: 108271|app: 0|req: 610/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Aug 25 01:39:37 2021] GET /compute/v2.1/servers/311b6a44-51eb-49e3-aee1-e24c57a2d392 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 01:39:38.659975 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: DEBUG nova.api.openstack.wsgi [None req-d9aabdcf-fcb1-46fe-a539-27af35848277 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] Calling method '.version_select at 0x7fd58d90b0d0>' {{(pid=108270) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 01:39:38.681961 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO nova.api.openstack.requestlog [None req-d9aabdcf-fcb1-46fe-a539-27af35848277 tempest-TestVolumeBootPattern-487509775 tempest-TestVolumeBootPattern-487509775-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1574037462" status: 202 len: 0 microversion: 2.1 time: 0.026034 Aug 25 01:39:38.682821 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: [pid: 108270|app: 0|req: 572/1182] 10.222.0.23 () {58 vars in 1263 bytes} [Wed Aug 25 01:39:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1574037462 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 01:40:28.809676 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:40:28.810537 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: Wed Aug 25 01:40:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:40:29.230775 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:40:29.231237 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: Wed Aug 25 01:40:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:42:23.952476 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:42:23.953176 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: Wed Aug 25 01:42:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:42:24.682334 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:42:24.682510 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: Wed Aug 25 01:42:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:42:24.875181 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:42:24.875654 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: Wed Aug 25 01:42:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:42:34.947195 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:42:34.947869 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: Wed Aug 25 01:42:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:43:48.827600 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:43:48.828209 dv-cinder-790014-2-iscsi devstack@n-api.service[108271]: Wed Aug 25 01:43:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 25 01:43:49.249222 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 01:43:49.249657 dv-cinder-790014-2-iscsi devstack@n-api.service[108270]: Wed Aug 25 01:43:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!